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| This text ts designed as an introduction to elements of probability theory and Mathematical 
Statistics, aiming to reach the mid-high, but beginning at the lowest level. The approach at 
places is thus heuristic and less rigorous, using elementary knowledge of mathematics. The 
attempt is to develop in the student an intuitive as well as mathematical feel for the subject, 
which enables the reader to think scientifically. Not all topics of the subject are included, 
which are otherwise presented by the authors in their Text on Mathematical Statistics 
(1989). But topics presented are in greater detail and profusely illustrated. 


Additions/Improvements to this Edition 

Ф Avery brief and naive knowledge of random variables and their expected values is 
included in Chapter 1 (81-42 & 81-43). This has resulted in shorter solutions to 
some problems by using mean values of binomial and Hyp-geom variates. Besides, 
it has provided notational advantage. 

€ Some Combinatorial solutions are replaced by routine solutions which are based 
on integer-solutions to the equation x, + x; +... + x, 7 m where х;> 0 or x; 2 0, 
1 € € n. The proof of this result as well as several other results (with or without 
proofs) are presented in section "Some Useful Formulas" pages 819-829. This shall 
secure firmness for math-feel. 

Ф Useful comments on Surprise and Uncertainty (81-9) will incite interest for Modern 

Information Theory. 

Multistage p-Rule, Multistage Conditional p-Rule (82-10) and Multistage E-Rule 

(85-41), frequently called conditioning processes, have an infinite potential to handle 

unlimited number of situations in the simplest possible manner. This extends the 

Frontiers of knowledge and we have exhibited it frequently. 

Indicators play an excellent shortening-device role in very laborious evaluations in 


Probability Theory. Their use calls for more intelligent manupulations, frequently 
asks for a sharp imagination. Their use in §1-53 and $5-43 is remarkably 


demonstrated. 


To smash the myth that Conditional Expectation (Chapter 7) is more involved, we 
include more, Solved Problems on this valuable concept. This must expel any pseudo 


tensions, if any. 


Ф Characteristic Functions for integer-valued periodic fun tions (89 40) ^ direct 


evaluation of the Ch. function of Cauchy distribution (89-70). 


Ф Structural similarity between bin (n, p) and Hyp-geom (N, M ; К) in $1521. 


$ For solutions to Numericals on Normal Distribution [Chap 16], both types of 


Statistical Tables : P(- = < Z < z) and P (0 < Z € z) are provided for ease and bent 
of mind of the individual solver. 


€ Proof of Stirling’s approximation to n! by using CLT [817-1 3]. Our proof is more 


elementary than the existing ones. 


Ф Geometric presentation of Rejection Method [818-31]. This shall inculcate Simulation 
of Variates more smoothly. 


@ This Edition contains more than 900 fully worked-out distinct problems. For their 
rapid coverage, 542 problems are starred and their solutions are provided at the 
end of the Text [pp. 659-818]. This shall provide flexibility, encourage self-attempts 
and the speedy completition of the course contents. 


@ Each chapter or its Appendix, starts and ends with a witty quote. Ponder over them 
for amusement and even for learning. 


Warmest thanks are due to Prof. Surjit Singh Khurana (lowa University, USA), Prof. Kanwar 
Sen (University of Delhi) and Dr. K.P. Chinda (Principal Keshav M.V. Univ. of Delhi) for 
their helpful discussions. | am also thankful to the publishers for their diligence. 


| owe a gratitude to Prof. Jiwan Lal Tiwari, who taught me mathematics for my B.A. (Hons) 
Course in session 1951-1953. What learnt in mathematics is a lot due to his efforts. | am 
extremely indepted to him and shall remain ever indebted for his kindness, courtsy and 
helpful attitude. 


1-Vaishali, Pitampura, Delhi-88 BANSI LAL 
Phone (R) 27317618 
1st December 2005 


Preface to the First Edition 


This book provides an extensively detailed and reasonably rigorous introduction to 
Basics of elementary parts of Probability Theory with emphasis on Probability Models and 
some Statistics. The material is based on the thorough revised version of several Chapters 
from “New Mathematical Statistics" (1989) and the target space is the new course structured 
r Mathematics, Honours of Delhi U niversity, although its periphery is all Indian Universities. 


The major goal of this text is to help the reader digest the fundamental ingradients of 
Probability and its allied concepts without much pain and effort. To achieve this objective, 
clear statements of pertinent Definitions, Pr inciples, Theorems and Comments, together 
with 879 numbered solved problems are included. There are a large number of exercises 
to test one's grasp of the subject. These solved examples, ranging from insultingly easy to 


fo 


slightly difficult, mostly adopted from Indian Universities examination papers and Public 
Service Competition Examinations, serve to illustrate and amplify the basic structure of 
Probability concepts. Besides their examination values, these solved problems bring into 
sharp focus such fine points without which the students continually feel themselves on 
unsafe ground, and provide the repetition of basic principles which are vital to effective 
learning. The geometric-analytic duality which is inherent in “Introducing Probability & 
Statistics” pervades throughout the text. 


The text begins with the prime concept of Probability Set function and culminates 
with extensive study of probability to various probability models. To review completely the 
subject matter of each chapter, a good number of supplementary exercises are included in 
each major section of the concerned chapter. Some exercises embody counter examples, 
some probe the extensions to existing ones, while most of them are routine : getting-your- 
feet-wet type. Answers to most of the exercises are supplied or embedded in their structure. 


A glance over the table of contents will indicate to the reader some idea of material 
covered in this text book. Compared with most books, much elementary and lighter material, 
besides some slightly advanced stuff, consistent with Indian Back requirements, is included 
in an instantly digestible form. The study of Probability & Statistics is slanted, towards 
elementary mathematics rather than to commercial sciences. The reader will discover in 
this text, that several problems worked-out elsewhere, have much shorter and amazingly 
much neater solutions. The fine details provided to complicated situations will relieve the 
readers of their tensions. The relatively advanced material is generally, separated out from 
the main stuff so that choice of adoption is easily made. Appendices A, B, C, D, E and F as 
well as Chapters 7, 9, 10, 11 and 17 are pointers in this direction. Quite a lot of stuff 
appears for the first time in simple digestible form, e.g. §16-61 and §18-40 and so on. Many 
solutions shall strike novelty and better mathematization, mainly due to using Multi-Stage 
Rules, Generating functions and integration simultaneously involving indicators e.g. 85-90. 


In conclusion, we remark that it has been our endeavour to design a text-book that 
will help the Readers at all levels to have a grasp of fundamental concepts of Probability & 
Statistics that will be found useful in Mathematical Analysis and in all Pure and Applied 
Sciences, such as Physics, Chemistry, Computer Science, Biology, Education, etc. In quest 
of this objective, we have consulted a large number of books and a brief Bibliography at 
the end speaks of our gratitude to their Authors & Publishers. 


During the preparation of the MSS, we were guided by the advice and suggestions 
of Prof. D. L. Jain, Head : Dept. of Mathematics and formerly Dean : Faculty of Mathematical 
Sciences, University of Delhi, Prof Surjit Singh Khurana, Mathematics Department, University 
of lowa, lowa City, U.S.A.; Dr. James A Donaldson, Mathematics Department, Howard 
University, Washington D.C., U.S.A. and Dr. Y. P. Sabharwal, Department of Mathematics 
& Statistics, Ramjas College, University of Delhi. To them, we owe much more than words 
at our command can express. 


We are also obliged to Dr. Ajay K. Arora (Hans Raj College, University of Delhi) who 
has rendered the valuable service of reading the cumbersome proofs during the printing 


process and also prepared the Subject Index to this text. 
In the production process, Miss Indu Nair & V K Nair at Kamala Compu Compose, 
did a marvellous job and we are grateful to them for their courtsy, sincere and hard work 


extended by them. The Publishers : Deepak Handa & Ajay Handa, on their part have 


shown full appreciation of the task presented to them and deserve our gratitude. 
Finally, we put on record that without the encouragement and support of Mrs. Sarla 
Rani, this book would have remained only a dream. 


The authors will appreciate receiving the intimation of misprints and misconcepts 
and shall duly acknowledge such intimations with gratitude. 
1 Vaishali, Pitampura SANJAY ARORA 
Delhi 110 034 BANSI LAL 
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Before God, we are all equally wise — and equally foolish (Albert Einstein) 
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Most paid jobs absorb and degrade the mind (Aristotle) 


It is not certain that everything is uncertain. 


(Blaise Pascal) 


Elementary Probability. 
Basic Concepts 


1-10. Introduction 


The origin of probability theory stemmed from the analysis of certain games of chance 
popular in the seventeenth century. It has since found applications in many branches 
of science and engineering and this extensive application makes it a valuable study. 
Probability Theory is, as a matter of fact, a study of random or non-deterministic experiments 
and is helpful in investigating the regular features of these random experiments. 

By a random experiment, we mean an experiment in which : 

(i) All the outcomes of the experiment are known in advance. 

(ii) Any performance of the experiment results in an outcome that is not known in advance. 
(iii) The experiment can be repeated under identical conditions. 


The experiment in which we can completely predict the outcome is known as 
deterministic experiment. For example, the formula x = + gt? gives the position of the 


particle falling under gravity from a position of rest, at any time t. However, in random 
experiments, the situation is different. Consider the following situations : 


1. A fair coin is tossed. We assume that the coin does not stand on its edge. On any 
toss, it is known that either head or tail will appear but it is not known exactly what the 
outcome will be. Obviously, the coin may be tossed any number of times. 


2. A fair die is rolled. It is known that any of the six possible outcomes will occur but 
it is not known what exactly the outcome will be. The die may be rolled any number 
of times. 

In the present chapter, we shall first discuss the Classical (mathematical) or a priori 
approach to Probability Theory, which will be followed by the Statistical (frequency 
or posterior) and the axiomatic approaches. The relative merits of three approaches 
Shall also be examined. Before doing so, we settle some terminology and notations. 


1-11. Some Notions and Notations 
l. Sample Space. Given any random experiment, the set of all possible outcomes of 
"his experiment is called a sample space or outcome space. This set is denoted by 
Q (omega) or S and the individual outcomes are generally denoted by @ or s. 

Some Illustrations : 

E,. Toss a coin once : S$, = (Т, Н) 


(Т = tail, Н = head) 
E». Toss а coin twice 


5, = {(T, Т), (T, M (H, T), Vak H)) 
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E,. Roll a single Die TON 41, 23,4, 5, 6} (Number of eyes) 
E,. Roll of a pair of Dice 2299 = To, yy: x = 1, 2, mu yc 2. 6) 
E,. Toss a coin and roll a Die "un = DOM. D 0H, 2), .... (Н, ВОС), (1; 6)] 


Remarks. The sample space of a random experiment need not be unique. The particular 
sample space considered is a matter of convenience and expediency. For example, the 
sample space for the experiment Е, may well be represented by 5; = (0, 1, 2}, where 
0 means no head, 1 means one head and 2 means two heads. 

2. Events. the subsets of the sample space are called Events. 

(i) An event E is called elementary event if it consists of only one element, i.e. when 
E is singleton. 

(ii) An event which is not elementary is called compound event. 

We say that the event A occurs if the outcome of the experiment corresponds to the 
elements of A. 

3. Sure Event. Since S itself is a subset of S, so 5 is an event. Also s є S for all s, so 
the event 5 occurs at each observation, it follows that the universal set (sample space) 
S is the sure (certain) event. 

4. Impossible Event. The empty set Ø is a subset of 5 (the sample space), hence Ø is 
an event, as per our definition of event. Also s ¢ Ø for all s є S, so that (empty set) event 
(2 does not occur at any observation. As such @ is called the null or impossible event. 

5. Event Space. Let S denote the sample space of a random experiment. Then the set 
of all events including 5 and @ is called an event space; it is usually denoted by ғ. 
The set € is a very big set as compared with S. In fact, if 5 contains n elements, 
(i.e. S is finite), then є will contain 2" elements. In axiomatic treatment of Probability, 
we shall show how to reduce the event space. 

6. Mutually Exclusive Events. Events A and B are called disjoint or mutually exclusive 
(or incompatible) if A (| B = Ø. That is, A and B are alternate possible outcomes of the 
same trial. 

Notes. (i) Two distinct elementary events are always disjoint i.e. {a} N (b) = Ø 

(ii) Every compound event can be uniquely represented as the union of a set of 
elementary events, i.e. 


A €(s) U (5) 0... 0 (s,) [See below for У] 


Ж ‘Specific Terminology. Let A, B, C, ... be possible events. We shall follow as under : 


Notation Meaning 

AUB events A or B or both [at least one of two events] 
A(1B or AB events A and B [both occurring together, 

AUB event A or B but not both [i.e. with AB — 2] 

А с В А implies В [A is а sub-event of 8] 

A=B events A and B are identical 


A‘ or Aor A’ event opposed to A [complementary to A] 
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А- В= АПВ event A occurs but В does not occur 
АТВ event A conditional by the occurrence of event В. 
ААВ = AB © AB. either A or B but not both. 


Important note : 

(a) We shall frequently write AB instead of A N B. 

(b) A О B means A U B together with A N B = Ø. 

(c) A О B is an out-dated and ill-conceived expression for A U B or A U B. 

(d) Extensions to more than two events and their corresponding meanings are obvious, e.g. 
9 


AUBUC,ANBNC,AN(BUO, {ABCUABCUABC}H, UA; i- 1, 2, ... 
Associative, distributive and complement laws from Set Theory are frequently employed. 


8. Venn Diagrams. The diagrams, depicting the unions and intersections of various 
events are called Venn diagrams or Euler diagrams. Some simple combinations of the 
events (shaded), and their expressions are demonstrated below; the rectangle is denoting 


the sample space S. 


(ii) AUB 


(viii) ABU AC = (АОВ) П (АОС) (ix) A U (ВПС) = (A U B) П (AU C) 


(х) AUBUC (xi) AU B = АВТ] ABC AB (xii) AUBUC 


A figure of particular utility is the Euler diagram (xi) for two possible events A and B 
where events AB, AB, AB, AB are demonstrated and some facts like : 


A U B = A t} AB, A= AB U AB, AB = S - (AU B), AB CA, etc. are visually shown. 


9. Partition or Exhaustive Set of Events. A set {A;} of disjoint ev ents, 
(А, N A =Ø, Vi =] is called exhaustive set of events (OT Partition of S) if 
U, A, = S. This means that every point of the sample space belongs to one and only 
one of the events A.. 
1-20. Classical (or Laplace) Definition of a Probability Function 
Let S be an outcome space (assumed to be finite) of a given random experiment. Let 
n(S) be the total number of possible outcomes which are mutually exclusive (m.e.) and 
whose occurrences are equally likely. Let A € IE (event space) be an event with n(A) 
possibilities. The probability of event A occurring, written P(A), is defined by the number 
P(A) = n(A) _ Number of cases favourable to A 
n(S) Exhaustive number of cases in $ 


S 
Obviously О < P(A) < 1, since 0 € n(A) € n(S), [Probability Scale]. 


[A priori approach] ...(1) 


i 


1-30. Two Basic Laws of Probability Theory 
1. Addition Law for Two Events : 
If A and B are any two arbitary (possible) events in a sample space S, then 

P(A UB) = P(A) + P(B) – Р(АВ) TP 
Proof. Denote the number of cases favourable to the events A, B, A U B and A N B by 
n(A), n(B), n(A U B) and n(AB) respectively. By counting the points in various sets of 5, 
we see that (See the Euler's diagram) 


n(A) = n( AB) + (AB), п(В) = n(AB) +л(А В), n(A U B) = п(АВ) + п(АВ) + n(A B). 
Eliminating n( AB), n(AB) provides 

n(A UB) = п(А) + n(B) – n(AB). 
Divide this equation throughout by N = n(S), to get 


n(AUB) _ n(A), п(В) АВ) 
N iV N Now, 

By Laplace (Classical) definition of mathematical probability, this equation is equivalent to 

P(A UB) = P(A) + P(B) – Р(АВ). 
Cor. If A П B = ©, i.e. if the events are mutually exclusive, then there is no point 
favourable to the simultaneous occurrence of A and B so that P(AB) = 0. Equation (1) 
then reduces to 

P(A U B) = P(A) + P(B). 
Extension to three events. For three events A, B, C 
 FAUBU C) = P(A) + P(B) + P(C) – [P(AB) + P(BC) + P(AC)] + P(ABC). 
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Proof. Replace B by B U C in (1) to obtain Oi o usu 
P(AU BUCO) = P(A) + P(BU C) – РАП (BU C)] 
= P(A) + P(B U C) - Р(АВ U AC), [Distributive Law] ...(1) 
Apply (1) to (i); use AB П AC = ABC, to obtain 
P(A U BU C) = P(A) + [Р(В) + P(C) - Р(ВС)] - [P(AB) + P(AC) - Р(АВС)] 


= P(A) + P(B) + P(C) - [P(AB) + P(BC) + P(AC)] + Р(АВС). ...(2) 
Comments. Write S, = P(A) + P(B) + P(C), S, = P(AB) + P(BC) + P(AC), S, = P(ABC) 
P(AUBUC) =S,-S,+5,. ...(2) 


2. Theorem of Compound Probability or Product Rule : 
If A and B are any two possible events of a sample space S, then 


P(AB) = P(A) P(B | A) = P(B) P(A | B) (1) 


антара [oma [D "u^ | 
ee oe 


Proof. Denote the number of cases favourable to the events AB, AB, AB and AB by 
пуу. 1 уу, M9 respectively (as shown in the above Table). Let N be the total numbers 
of cases in the sample space. By Laplace (classical) definition of the mathematical 
probability, 


11 11 т 
Үй р SNOL TEE = 
N (АІ В) : а (1) 


Неге P(A | В) = probability of event A relative to the space of event B. [This is the 
obvious classical Def. of conditional probability] 
Лү us n|/N |. SPAB) А 
n, * ny 7 (n, +n,)/N tn;)/N = РВ) ` [by (1)] [P(B) = 0]. 
We rewrite the above equation to obtain P(AB) = P(B) P(A | B). 
The other result follows by interchanging A and B. 
Extension to Three Events. For the possible events A, B, C 
P(ABC) = P(A) P(B | A) P(C | AB). 
Proof. P(ABC) = P{(AB)C] = P(AB) P(C | AB) 
= P(A) P(B | A) . P(C | AB). [by (1)] 
Definition. Events A and B are said to be independent if 
P(A \ B) =P(A), or P(B | A) = P(B). 
Product rule for two and three independent events : 
P(AB) = P(A): P(B), P(ABC) = P(A) P(B) P(C). 
Remarks. Solutions to problems of Probability and Statistics require various manipulative 
skills, which are quoted for constant use in the Chapter zero of this book. 


P(A) = In as РОВ) =! ^ 


7 ВЄАВу = 


Obviously, P(A |B) = 
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1-40. Procedure for Solving Probability Problems 

1. Choose an appropriate sample space which includes as subsets all of the events А, 
to be considered. 

2. Identify all of those events A, to which reasonable pr 
can be assigned and make these assignments. 

3. Describe the event A for which P(A) is to be computed. 

4. Relate A to the other events A,, which fix up A. 

5. Apply the various laws of Probability and the definitions of allied nature, Eg. 
independence, conditional probability, disjointedness, etc. Compute P(A) and examine 
if this makes sense. 

6. If P(A) is not precise, find the good approximation or useful bounds for P(A). 
Comments. In practice, some of the steps are mixed up together, and (6) is seldom needed. 


1-41. Worked-out Problems 
Example 1. Three numbers are selected at random one after another and without 
replacement from m numbers 1, 2, ..., m. Find the probability that : (1) The first number 
drawn is the smallest and the second number the largest; (ii) The first number is smaller 
than the second number. 
Solution. To each triplet of numbers out of (1, 2, ..., m) there correspond six 
permutations (ordered triplets). Let us suppose that three numbers withdrawn аге a, Ё, c 
and that a < b < c. The possible sequences of withdrawals are : 

S = (abc, acb, bca, bac, cab, cba) : six possible outcomes. 
(i) The event of interest A = {ach}, has the probability P(A) = 1/6. 
(ii) The event of interest B = (abc, acb, bca}, has the probability P(B) = 1/2. 
Example 2. An urn contains N balls numbered 1, 2, 3, ..., N. Find the chance that 
exactly k of M specified numbers will be among a sample of n balls, withdrawn from 
the urn. 


obabilities (ordinary or conditional) 


Solution. The exhaustive number of cases is t = чу Specification partitions the set 


into two subsets consisting of N – M and M numbers. If k numbers are from the specified 
M numbers, these can be selected in ^C, ways. The rest of n — k numbers must be 


. (М-м 
selected out of N — M numbers in PEN ways. 


By the Sequential Principle of Counting, the total number 
of favourable cases is f 


|. (MY N- M 1 f _(M\(N-M N Hypergeometric model 
mee мк ima 


Example 3. An urn contains N balls numbered 1 through N, where the first D balls are 
defective and the remaining N — D are non-defective. A sample of size n balls is drawn 
from the urn. Let A, be the event that the sample of n balls contains exactly k defectives. 
Find P(A,) when the sample is drawn (i) without replacement and (ii) with replacement. 


§1-41. Worked-out Problems T 


Solution. (i) Suppose numbers on the л bails аге v,, v,, ..., v, and take 
€ = [{v,, v», ..., d v, are numbers on л balls] so that О is made up of subsets of n. The 


ok { s N i 
number of subsets of size n of the N balls is t = ЫЯ and all such selections may be 


treated equi-probable. Now A, consists of those subsets of size n which contain 
exactly К defective balls from the balls that are numbered 1 to D inclusive. Such а 


selection can be had in x) ways. The remaining (n — k) balls are to be drawn from 
: “р 
balls numbered D + 1 to N and this selection can be made in Wae] ways. By 


; ' s D\( N- D 
sequential counting the favourable cases for the required event is f= (2) Er] 


ray =F -(2) se) 


(ii) Under replacement scheme, the total number of drawing n balls out of N balls in 
(№)", since at each draw, the ball can be one from 1 to N inclusive. Let v; be the number 
of the ball drawn on the jth draw so that О = {(v, ..., v,)]. Now A, consists of exactly 


ways. Hence 


k of the v/'s balls numbered from 1 to D inclusive; these k balls can be selected in (e) 


ways to fill k positions out of n available positions. For each different (7) selection, 


there are D* iD) * different n-tuples (listing) by Sequential Counting. Hence 


дары D'(N - DY [ny uk д [p- D/ N,q-1- p] 


Example 4. A car C is parked among N cars in a row, not at either end. On his return, 
the owner finds that exactly r of the N places are still occupied. What is the probability 
that both neighbouring places are empty ? 


Solution. On his return, the owner finds that exactly r of N places are still occupied. 
This includes the space occupied by car C as well. This means, the remaining (r — 1) 


cars are parked in (ће (№ — 1) slots. This provides the total choices г = Us h 


Since the neighbouring slots to car C are empty, it follows that the remaining 
(r — 1) cars are parked among the (N — 3) slots. This provides the favourable choices 


as f = = ) Consequently, 


co Mom ff тү Gon Ar phe (7m rer D 
P That ys eatin r-1] (N-3«N-r-2)! (N-D(N-2 © 
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ey. : 2 í om. 
Example 5. Out of m persons sitting in a row, n are chosen at rand 
probability that no two of the chosen persons were seated together. 
Р, Р, P3 Р, NT Pn-1 Pn 
———————9————eS—————————Má 
Xn-1 Yn 


Yo Хү Xs Xj 


' t such selections 
Solution. Suppose the n persons chosen are P}, P;, ..., Р,- The number of su 


Find the 


of n persons out of m is N = m 


n 


Let y, be the number of persons to the left of P, and y, be the number of persons to the 
right of P, (the last person). Let x; be the number of persons between P, and P, , ү. Then, 


Yo Z 0, y, 20, but x, 2 1, 12 j&n- 1. 
Yot (х *tx,t..4x, )*y,-m-mn. (Number of unchosen persons). 
Let xj = yo + l, x, = y, + 1, so that x, > 0, = 0, 1, ~ n. 
The preceding equation now reduces to 
Xo XQ tx, (tX, = т-п + 2, x; > О (strictly). 


The number of solutions of this equation, in positive integers, is 


2 (m—n+2)—1)._(m-—n+1 
ESI (n-D-1 Jat n | 


me ре de^ a "ЫЕ! 


Example 6. Out of N tickets consecutively numbered, 3 are drawn at random. Find 
the chance that the numbers on them are in arithmetical progression when 
(i) N = 2n, (ii) N = 2n + 1. 

Solution. In any choice of 3 members in A.P., say, a — d, a, a + d, the sum of extremes 
is always even [(a — d) + (a + d) = 2a], being twice of the middle term. Two such 
numbers, say, x and y, whose sum is even must be drawn either from E (even-numbered 
set) or from O (odd-numbered set). 

(Tee oe, 2 = 165, 5, Anl EIE ony. 
AsxeO,yeOorxeE,yeE 


‚-@+@-ф-но-ь 


d 2n! — 2n(2n-D(n-1) 
3 


The exhaustive number of cases = E = 


~ 31(2n—3)! ^ 
3n(n — 1) 3 


p = VUES SR 


"2nn-D)Qn-1 2Qn-ly 


fn) М =2n + 1,021, 3,5,...,2n +1}, E (2, 4, 6, ..., 2n) 
Аѕхє О, ує О or xeE, yc E, 


2n + | GL n(4n? — 1) 


Th sti = E + 
е exhaustive number of cases = | 3 31(2n — 2)! 3 


Зп? К: 
nn р) idm -1) 
| Example 7. Compute the probability of each of the following 5-card poker hands : 


(a) Royal Flush (10, J, О, K, A: all of the same suit} 

(b) Straight Flush (Five cards of the same suit in a sequence) 

(c) Four of a kind (Face values of the form x, x, x, x, y ; y # x) 

(d) Full house (Face values of the form x, х, х, y, у; y # x) 

(e) Straight (Five cards in a sequence regardless of suit) 

(f) Flush (Five cards of the same suit, but not in a sequence) 

(g) Two pairs (Any two distinct face values occurring exactly twice). 


Note. Spade Flush (Five spades), Ace-high spade flush (five spades with the ace). 
Ace-high fall house (three aces with another pair). 


Solution. A poker hand is a 5-subset of the set of 52 cards in the full deck, and hence 
there are N = a different poker hands, since order is of no consequence. 


(a) There is one royal flush in each of the four suits, hence probability = 4/N. 

(b) There are ten sequences of 5 cards, starting with the sequence 12345 and ending 
with the sequence 10 JQKA in any particular suit, say Diamonds. Hence the total 
number of 5-card sequences is 4 x 10, whence p = 40/N. 

N.B. Some people consider straight flush devoid of royal flush. For such a case 
p = (40 — 4)/N = 36/N. 

(с) Here (x, x, x, x, ; y), e.g. (5, 5, 5, 5, 8) and it involves all the four suits. We choose 
the face value x to appear four times (thirteen choices : A, К, О, ..., 2) and for the 5th 
card, there are 48 choices. Hence f = 13 x 48 = 624. Thus, by Laplace definition, 
p = 624/N, or 


1 624 
P(Four of a kind) = (4) (4 Ror 12 2) = 9. 


и faa 37 7944 
(d) P(Full house} = pe 13x (4) А 


Here there are 13 choices for x (one value) and 12 choices for у (second value). 

(e) The sequence of face value may be chosen in 10 ways. The suit of each card in а 
straight may be chosen in 4 ways. Thus, the suits of 5 cards may be chosen in (4) 
ways and the probability of a Straight is, thus p = 10 x 4°/N. 


LÍ 


V : ' We chosen more 
iu езе means the same item con: 06 
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+, (13) ways and since there are 
(f) Five cards from the diamond-suit can be chosen In fi way 


(5) Hence 


M 1 D sul № iS 4х 
four suits, the total number of choices from all the four suits 


р =4х (2)/ = 0.002. 


This is the flush of any kind. Now to eliminate the possible sequences 1n th 
we need to have, using (b), the favourable cases 


4х (2)- 4o =5148 – 40 = 5108 => p = 5108/N. 


(g) Two pairs : (x, x; y, у, z) e.g. (2, 2; 9, 9; 5). The two face values х, y can be chosen 


ese 5 cards, 


out of 13 designations (2, 3, J, Q, K, A] in (2) ways. For each of the two designations, 
we can choose the two suits in (5) ways. The remaining Sth card z (e.g. 5) has to be 


chosen from 44 cards [52 — [2, 2, 2, 2, 9, 9, 9, 9] in кч ways. Thus, 
P{Exactly two pairs} = (5) (3) (‘4)/w. 


Problems with Solutions Provided at the End of the Text 


1*. At a bridge (game) hand North and South have n cards of one suit (trumps) 5. 
Find the probability that one of their opponents (East or West) will have exactly 
k cards of that suit and the other will have the rest. 

2*. From a set of 17 cards, numbered 1, 2, ..., 17 ; one is drawn at random. Show that 
the chance that the number is divisible by 3 or 7 is 7/17. 


3*. What is the chance that (i) a leap year, (ii) a non-leap year; selected at random 
will contain 53 Sundays ? 
4*. А bag contains 50 tickets numbered 1, 2, ..., 50. Five tickets are drawn at random an 


А І d arranged 
in ascending oder of magnitude : x, < х, <... < ху. What is the probability tha 


tx, = 30? 

5*, What is the probability of getting 9 cards of the same suit in one hand at a game of Mie 9 

6*. An urn contains 4 white, 4 red and 4 blue balls. Three balls are dr 
chance that all three colours are represented when (i) sam 
and (ii) without replacement. 


7*. If three small squares are chosen at random on a chess-board, 
that they are in a diagonal line. 

8*. A girl holds six strings in her hand with the ends 
protruding above and below and her friend ties 
together the six upper ends in pairs and then ties 
together the six lower ends in pairs. What is the 
probability that at least one ring will be formed ? 


awn. Find the 
pling with replacement, 


find the chance 


| 


a b EA, 


without vegdacewent-— means the came tem camet be selected m 


ore than once 
P Кла nada REM UP matter. Per mutation- jt. osg 


A*, 


wW. 


11* 


12* 


13". 


14*. 


5”. 


16%. 


17%; 


18%. 


19*, 
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$1-42. Random Variables or Variates 1 1 
Given a group of 4 people, construct an event space from which it is possible to 
find the probability that : 


(a) Exactly two have the same birth month (event £,). 

(b) At least two have the same birth month (event L.). 

(c) No two have the same birth month (event D : different). 

Assume that the probability that a person have a particular birth month is 1/12 
Suppose 7 balls are distributed at random into N boxes. What is the probability that 

(a) No box has more than one ball ? 

(b) A specified ball is in a specified box ? 

Out of 3n consecutive numbers, 3 are selected at random. Find the chance that 
their sum is divisible by 3. 

A bag contains 8 black, 3 red and 9 white balls. If 3 balls are drawn at random, find 
the probability that (a) all are black, (b) 2 are black and 1 is white, (c) 1 is of each 
colour, (d¥ the balls are drawn in the order black, red and white. 
A and B stand in a ring with 10 other persons. If the arrangement 
of the 12 persons is at random, find the chance that there are 
exactly 3 persons between A and B. 

A and B stand in a ring with л other persons. If the arrangement 
of the (n + 2) persons is at random, find the chance that there 
are exactly k persons between A and B. 

Four girls a, b, c, d line up in random order in front of D.T.C. Pass Section. 
What is the chance that a precedes b and c ? 

An urn contains n red and m black balls. All the balls are withdrawn one at a 
time. Find the chance that no two consecutive black balls are witdrawn, n > m — 1. 


An urn contains w white and b black balls. The balls are drawn randomly one by one 
until those of the same colour are left. What is the probability that they are white ? 


From a pack of 52 cards, an even number of cards is drawn. Show that the 
[521/ Q6)? ]- 1 
ton: ela 


A and B stand in a row with л other persons. If the arrangement of the (л + 2) persons 
is at random, find the chance that there are exactly k persons between A and B. 


probability of half of these cards being red is 


Random Variables or Variates 


Very old fashioned but still very useful and most intuitive definition describes a random 
variable (r.v.) as a variable that takes on its value by chance. This older definition just 
stated serves quite adequately, in almost in all instances of probability modelling. In 
fact, this older definition has served over a century of meaningful progress in probability 
theory. [Modern approach appears in Chapter 3 onwards]. 

Conventionally, we use capital letters such as X, Y, Z to denote the r.vs. and lower case 
letters such as x, y, z for real numbers that such variates assume as their values. The 
probability that the event (X € x] occurs, is stated as 
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F(x) =P{X € x), —oo < X < 00 
and is called the cumulative distribution function of the r.v. X,a 
d.f.). Note that F(x) contains all the information available about t 


P(X»x) =1-F(x), Pla < X < b) = F(b) - F(a) 
P{X =a} = F(a) - lim F(a - е) = F(a) - Каш}, 


bbreviated c.d.f. (or even 
he r.v. X. For instance 


If there is a finite or denumerable set of distinct values хү, X» such that P(X = х) =E; 2, 
for i = 1, 2, ..., Ур, = 1, then X is called discrete г.у. and р, is called its probability ШЕ; 
function (p.m.f). If p(X = x) = 0, V x € R, then г.у. X is called continuous. If there is a 


non-negative function f(x), defined for —o « x « o such that. 
Pla«X«b) = [fG)dx -о<а<Ь<® 


then f(x) is called the probability density function (p.d.f) for the r.v. X. 

There is a galaxy of standard p.m.fs. and p.d.fs., which describe various phenomena 
and are described in the succeeding chapters. 

Bernoulli Random Variable. A variate X such that P{X = 1} = p and P{X = 0} = 1 —p 
is called Bernoulli variate. It is frequently used as indicator of an event A, written 
ІА) or 1, and defined by 


Į, = Ј ifA occurs, probability R 
А 10, otherwise 


1-43. Expected Values 
If X is a r.v. and g is a function, then g(X) is also a г.у. If X is a discrete г.у. with 
possible values x), х), ..., X; ..., then the expected value of g(X) is denoted by E(g(X)) 
and is defined by - 

E(g(X)) =X; p@) . g(x) 44) 
provided the sum in (1) converges absolutely. If X is continuous with p.m.f. : f(x), 
then E(g(X)) is defined Бу. 


E(gQ0) = 700-20) — (2) 


provided the integral is absolutely convergent. 
The special cases : g(X) = X, xt 4 X” frequently occur. Thus 


Е(Х) = Ep(x) x; EX) = Lp) xj i = 1, 2,... (X : discrete) 
E(X) = (^ fa) x dx, EX) = | РО) х" dx, (X : continuous) 


The quantity E(X) is usually denoted by р and is called expected value of X or mean 
value of X or simply mean (of X). This occurs most frequently in probability theorv. 
The most valuable property of expectation is the linear property of E (written Lin А 


and is given by 
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E [ag(X) + bh(X) + c] = aE[g(X)] + bE(h(X)] + c 
where a, b, c are constants and g, / are arbitrary functions. 


Comments. A specific p.m.f., called hypergeometric distribution, is defined by 


P{X =n) = (2 ые), х=0,1,2,...,п 

We often write it as Х ~ HG (a + b, a, п) 459 

It is proved later on, that 
E(X) = np, where р = a/(a + b). 

We use this result in Chapter 2 to offer shorter evaluations. 

On use of Indicators 

The Bernoulli r.v. X with parameter p, identified as indicator of an event A yields 
E =1.р+0.(1- р) =р= P(A) 

Thus, P(A (А) = Е(1,) = 

This simple iio. of using Indicators PIU reduces formidable calculations 

into trivial evaluations. 


Illustration. Show that У, Ў а a; p; Z0. [py = Р(АА,)]а, ER. 


t=] j=l 


To prove it, we note that 


os| $a I, i = [Sa ^ (Ee. I) 


"s 224,8; Is In, * Ya, TAA, 
f esi 


Taking expectation of both sides, using E(/,, A? = P(AA) yields the stated result trivially. 
A direct attack to evaluate is indeed very difficult. 
An excellent use of indicators is shown in getting Poincare's inequalities [See $1-53] 


1-44. Two-Dice Experiments 

Two fair dice are tossed simultaneously, their outcomes о = (x, y) are recorded. Let S, 
D, T, M, m denote sum, difference, product, maximum and minimum of the eyes 
shown. Record the sample space and their joint probability distributions. The probability 
of each of the 36 outcomes is p = 1/36. The individual probability mass functions and 
joint mass functions follow this table : 


— | 


les for ready-reference 


Basic Concepts 


E l ementary Probability: 


ab 


for future use. 


EX. 
му 
Ш 
и м 
aw 
"БУ. м 
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TIU. 
Ea 
wc 
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E 
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C MEM NE 
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oa i 
A 1i 
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28 
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N 


= 6 – 17 – К/36, k = 2, 3 


Sp} 


a 


Summary. 
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2. Distribution of Maximum. Let M, denote that max. (x, y) = k. Then table yield 
P(M |) = р, Р(М,) = Зр, P(M4) = Sp, P(M,) = 7р, Р(М,) = 9p, PM = 11р 
Distribution of the Maximum Distribution of the Minimum 


EQ fb ile | 
эз + 
Pe ЕЛЕЕ 
PEE Pett fn 
инки 
PsP pot 
ер» 
re Pe De Pele 


4I 


БЕРЕТТ 
Е 
[= [eel = feel = [eel = Peel = ol = 2 
1 [ә 
= ъ= 
=- mah BEBAR 


Z1 

"-— Ен 
ЕЕЕ = 
къа et 3 
les. 


| 


Note. These tables can be adopted for tetrahedral dice by considering | < x, y < 4. 
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Ехетсіѕе 1(а) 


An urn contains 30 identical balls numbered from 1 to 30. If a ball is selected at random, 
show that the probability that the number on the selected ball is (a) an even number is 1/2, 
(b) an odd number is 1/2, (c) a number divisible by 5 is 1/5. 
Two dice are thrown. Find the probability that the sum of scores on the dice is (a) 9, (b) greater 
than 8, (c) either less than 8 or odd. 
Verify that chance of throwing more than 7 equals that of throwing less than 7, each being 5/12. 
A bag contains 5 red, 6 black and 3 white balls. Three balls are drawn at random. Show that 
the probability that there is one ball of each colour is 45/182. 
(a) Froma pack of 52 cards, three are drawn at random. Show that the chance that they are a 
king, a queen and a knave is 16/5525. 
(b) The 52 cards of a deck are placed successively one after the other and from left to right. 
Find the chance that the 13th Heart will appear before the 13th Spade. 
Two cards are drawn from an ordinary pack. Show that the probability that 
(a) Both are aces is 1/221, (b) One is a king and the other a queen is 8/663, (c) One is a spade 
and the other a heart is 13/102. 
A number is chosen from each of the two sets A and B. 

A-11,2,.3,4:5.6,7, 8,9]; B={4,5.6, 7, 8,9]. 
If p, is the probability that the sum of two numbers be 10 and p, the probability that their sum 
is 8, find p, + p>. 
Six faces of a die are marked with the numbers 1, —1, 0, 2, —2, 3. If the die is thrown thrice, what 
is the probability that the sum of numbers thrown will be equal to 6. 
Two different digits are chosen at random from the set { 1, 2, 3, ..., 8}. Show that the probability 
that the sum of the digits equals 5 is the same as the probability that their sum exceeds 13, 
each being 1/14. Also show that the chance of both digits exceeding 5 is 3/28. 
(a) Two dice are thrown. It is given that one of the dice shows 5 points. Show that the 
probability that the sum of points on the two dice being 9 is 1/6. 
(b) Two dice are cast. Person A wins if the sum of numbers showing up is < 6 and one of the 
dice shows 4. Person B wins if the sum is 2 5 and one of the dice shows 4. Prove that 
P(A wins) = 4/36, P(B wins) = 11/36 and P(both A and B win) = 4/36. 


(a) A number of two digits is chosen at random from numerals 1, 2, ..., 9. Show that the probability 
that the number so chosen is even and less than 60 is 1/4. 


6) Urns А and B contains n chips numbered 1 to л; one chip is drawn from A as well as from B. 


Show that P(chip drawn from B bears a number smaller than that from A) =(n—-1)/2n. 
From 100 tickets numbered 1, 2, ..., 100, four are drawn at random. What is the probability that 
three of them will bear numbers 1 to 20 and the fourth will bear any number from 21 to 100 ? 


The first 12 letters of English alphabet are written down at random. Show that the probability 
that there are exactly four letters between A and B is 7/66. 


An urn contains M balls numbered | to M. A sample of size n is drawn without replacement, 
and balls are arranged in increasing order of their numbers x, < x. < 
from 1 to M and К a number from 1 to n. Show that Due 


P(X,- К} = Ege dun 


< х. Let К be a number 
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14. ien, 2 women an 


Four persons are sen ; T ini 
r persons are chosen at random from a group containing 3 men, 2 women and 4 children. Show 
that the chance that exactly two of the them will be children is 10/21. 


15. In agame of whist (where 4 players play), prove that the chance that the 4 kings are held by 
a specified player is 11/4165. ' | 
16. In a Bridge-party, North has four aces. Find the probability that he gets a king of spade. 
17. Show that the probability that at a Bridge game, (i) a hand holds 4 aces is 11/4165, (11) a hand 
holds exactly six spades is 39! (13 !)2/52 17 ! 6 !. 
18. Let n biscuits be distributed among N beggars. Find the chance that a particular beggar 
receives r (« n) biscuits ? 
19. m men and w women seat themselves at random on m + w seats arranged in (i) a row, (11) circle. 
Find the probability that all the women will be adjacent. [p, = (m + 1)/" С, ]. 
.—20. Each coefficient in the equation, ax? + bx + с = 0, is determined by throwing an ordinary die. 
Obtain the probability that the equation has (i) real roots, (ii) equal roots, (iii) rational roots. 
жк 2n people are queued up at a theatre box office; л of them have only 5-rupee bill and the 
remaining n only one 10-rupee bill. There is no cash in the box office when it opens and each 
customer in turn is going to purchase a single 5-rupee ticket. Show that the probability that 
no customer will have to wait for change is 1/(1 + n). 


Re-arrangements of Words : 

22. Letters are drawn one at a time from a box containing the letters : A, H, M, O, S, T. Show that 
the probability that the letters in the order drawn spell the word ‘THOMAS’ is 1/720. 

23. Letters of the word LATENT are written on six cards. The cards are shuffled and then drawn 
one at a time at random. Show that the probability that the word ‘TALENT?’ is formed is 1/360. 

24. A letter is taken out at random out of “ASSISTANT” and a letter is taken out of ‘STATISTICS’. 
Show that the chance that they are the same letter is 19/90. 

25. If the letters of the word “REGULATIONS” be arranged at random, show that the probability 
that there will be exactly 4 letters between R and E is 6/55. 

26. Show that the probability that in arandom arrangement of letters of the word “UNIVERSITY”, 
the two /’s do not come together is 4/5. 

27. Inarandom arrangement of the letters of the word COMMERCE, find the probability that all 
the vowels come together. 


1-45. Shortcomings of Classical Approach to Probability 

In spite of its elegance and utility, the classical definition suffers from some serious 
defects. Some of the drawbacks are hinted below : 

1. The definition of classical probability is circular, in the sense that ‘equilikely’ and 
‘equiprobable’ are synonymous terms which form the definition unacceptable. Because 
of this difficulty in deciding about the equilikely alternatives, serious errors are 
committed. In this context, we give an example, which is now known as D’ Alembert’s 
Paradox : Let two coins be tossed. D'Alembert argued that there are three possible 
cases, viz. : (i) Both heads, (ii) Both tails, (iii) One head and one tail, and he thus 
concluded that the probability of a head and a tail is 1/3, which is obviously not true. 
In fact, the actual probability is 2/4 — 12. E 
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We may conclude that the wrong decision about the equilikely cases can lead to errors, 
-committed even by great Mathematicians. 

2. In many problems, the possible number of outcomes is infinite. For instance, the 
intuitive answer, on the basis of classical definition, to the probability that a positive 
integer chosen at random is even is 1/2. The plausible argument, that out of first 2n 
positive integers, n are even, so p = n/2n = 1/2 (fixed), even as n — © (so as to cover 
all positive integers) is not an easy matter to make it acceptable. For one thing, it 
depends on natural ordering of positive integers and so a different ordering would 
yield a different result. For example, for the ordering : 1, 3, 2, 5, 7, 4, 9, 11,6; p= 1/3. In 
fact, just by choosing some ordering, we could obtain any probability that we desired. 
It follows that, the classical definition does require modification. 

3. Since classical definition is based on equiprobable events, it naturally fails to solve 
problems related to events which are not equiprobable. For example, for a loaded 
coin which is biased in favour of head, the classical definition fails to give correct 
answer, since the outcomes are not equally-likely to occur. 

4. The classical definition offers very limited uses. It fails to respond to querries like : 
What is the probability that an Indian shall live upto the age of 80 years ? What is the 
chance that a bulb will burn 100 hours or more ? What is the chance that two cars 
going through the same intersection will collide ? 

These questions cannot be dealt with by using classical definition because ‘symmetry’ 
and ‘equilikelyness’ cannot be guessed as in games of chance. 

Thus, we need to extend the classical definition in such a way that the new definition 
is able to overcome the various defects embodied in the classical-definition approach. 
To remedy the above deficiencies and the like, we introduce the relative frequency 
approach in the following section. 


1-46. Relative Frequency Approach to Probability 

In the beginning of the 20th Century, Richard Von Mises introduced the relative 
frequency approach by such considerations as under : 

Let an experiment under consideration be repeated N times and suppose that an event A 
occurs n(A) times. The ratio n(A)/N is termed the relative frequency of the event A. As the 
number of trials N increases, the relative frequency of the event A approaches (stabilizes) 
the number P(A), called the probability of event A; i.e. P(A) = lim n(A)/N. (№ — oo). 
For example, to predict whether the next baby born in a certain locality will be male 
or female, which is individually an uncertain event, we search for the long-run records. 
If the previous records show that 52% of the births are male, it is safe to postulate that 
the probability of a male birth in this locality is p and approximate p as 0.52. 

We may note that the laws of addition and multiplication for probability can be proved 
by relative frequency approach as well. 


Although the Frequentist Approach overcomes some of the deficiencies of Laplace 
classical definition, it has some demerits of its own. 
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In the first place, it is more in the way of a description rather than of a formal 
mathematical character. In physical experiments, the number N might be large but it i 

always finite ; therefore n(A)/N cannot be equated even approximately to a limit. In 
general, the relative frequency of an event tends to its probability but in its own manner 

not for certain, but almost for certain with a very high probability. 

The two types of probabilities (aprori and posteriori) have one important thing in 
common. They both require conceptual experiment in which the various outcomes 
can occur under somewhat uniform conditions. But we can have the situations where 
we cannot fit in the framework of repeated trials. For example, what is the probability 
that my wife loves me ? Or what is the probability that Third World War will start 
before Ist Jan. 2000 ? These types of problems are certainly a legitimate part of general 
probability theory and are titled “Subjective Probabilities”. We shall not discuss the 
subjective probabilities in this work, but the axioms of probability from which we 
develop the theory are rich enough, to include a priori probability, a posteriori probability 
and subjective probabilities as well. 


1-50. Axiomatic Treatment of Probability Theory 
Definition 1. Let Q be any non-empty set. A non-empty class F of subsets of Q called 


ite Fe Ae 7 >A е GWA. Eus ded d. o gives UA, є F. 
Коз Уу = <a Ан i - п =1 


Example 1. Let О be any non-empty set and F denote the class of all subsets of О. 
Then F is a o-field. 

Example 2. Let Q be any non-empty set. Then F = (OQ, О} is the smallest o-field 
associated with О. 


Example 3. Let Q be any non-empty set. Let A + ф be any subset of О. Then {@, A, A, Q) 
is a c-field. 


Definition 2. Let Q denote the sample space of an unidentified random experiment. 
Let F be a o-field associated with О. The elements of О are called sample points and 
the elements of F are called events. 

Definition 3. If Q is finite or it contains a countable number of elements then the 
sample space Q is called a discrete sample space. ЇЇ О is uncountable, then it is called 
an uncountable sample space. In particular, if О is rectangle (or interval) of the Euclidean 
space К", n > 1, then О is called a continuous sample space. The pair (О, F) is termed 
measurable space. 

Comments. In general, the o-field associated with Q need not contain all the subsets 
of Q. For example, if Q = (1, 2, 3, 4, 5, 6}, Die-sample space, then F=@, Q, (1, 2, 3], 

{4, 5, 6} is a o-field which does not contain all the subsets of Q, e.g. (1, 2) € F. 

In the present chapter, we shall concentrate on discrete sample spaces and o-field will 

be class of all subset of О, the underlying sample space. 
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Example 4. Toss a coin, then О = (H, T], (H is head and 7 is tail). Let ud T ү Er 
consisting of all subsets of Q. Then 7 contains 2? = 4 events including 2 elementary 
events ia | 
Example 5. Roll a die, then О = (1, 2, 3, 4, 5, 6). Let F be the o-field consisting of all 
subsets of Q. Then F consists of 2° = 64 elements (events) including 6 elementary 
events. 
Example 6. Toss a coin till the first head appears ; then 

B wm T E 
Let F be the o-field of all subsets of Q. Another way to describe Q is that we look at 
the number of tosses required for the first head. Clearly, then Q = uU SA 1, the 
set of positive integers. We then let 7 be the set of all subsets of positive integers. 


Exercise 1(b) 
1. (i) Give classical and statistical definitions of probability and their limitations. State axioms 
of probability due to Kolmogorov. 


(ii) Define o-field, minimal o-field and monotone field. Exemplify : A field containing infinite 
number of points, may not be a o-field. 


2. A, B, C are three arbitrary events. Express the following events in appropriate symbols : 


(a) Only A occurs (b) All three events occur (c) BothA and В, but not C occur 
(d) At least one occurs (e) At least two occur (f) Two and no more occur 
(g) One and no more occurs (h) None occurs 

(i) Every point of A is contained in B (j) Event В, but not A occurs 


(k) A, B, C are mutually exclusive events. 
[Watch Fig. $ 1.54, Rider: ABC, ABC, АВС, L, = AUBUC,L, = ABCU ABCU ABC U ABC 


_E,= ABCU ABCU АВС, E, = ABC U ABC U ABC, Ey= ABC, AC B, AB, АГВГ\С= JI 
3: For the experiment of throwing a die two times, describe the sample space and list all the 


elementary events in A U B and A f) B, where A = Number one in the first throw, B = Number 
one in the second throw. 


4. Enumerate the elementary events and give samples space when : 
(i) Two coins are tossed, (ii) Two dice are thrown. 
In each of the above cases, give two examples of composite events. 


5. Acoin is tossed 4 times. Define a sample space Q which describes this experiment and give 
the subsets of Q which correspond to the following events : 4 
(a) More heads than tails are obtained, 

(b) Tails occur on the even numbered tosses, 
(c) Heads occur on the third toss. 

6. A coin is tossed until it comes up with the same side twice in succession. To each possible 
outcomes requiring л tosses, assign the probability p = 2". Describe 5 : the space of elementary 
events and evaluate P(A) and P(B) where A = (Trial ends at the 6th toss), B = {Even number 
of tosses are needed). [Ans. 5 = (tt, hh, thh, htt, thtt, hthh, ...}; P(A) = 15/16, P(B) = 2/3] 

7. Describe sample space appropriate in each of the following cases. How many points are there 
in the sample spaces ? 


$1-51. Probability Set Function s 1 


(i) n-tosses of a coin with head or tail as outcome in each toss, 
(ii) Successive tosses of a coin until a head turns up, 
(iii) A survey of families with two children is conducted and the sex of the children (the older 
child first) is recorded, 
(iv) Two successive draws : (a) with replacement, (b) without replacement, from a bag containing 
4 coloured toys, out of which one white, one black and 2 red toys. 

8. A psychological experiment consists of submitting a subject to two tests and assigning for 
each test a score of 1, 2, 3, or 4 according to his performance. Define a suitable sample space 
Q for this experiment and identify the events A, B, C which denote the results : 

(1) At least one score is greater than 2. 
(ii) The first score is at least double the second. 
(iii) The difference in scores is exactly 2. 
Identify the events (1) A U C, (ii) AU B. (iii) AU C. Are any two of the events A, B and C disjoint ? 

9. An assembly of electronic equipment consists of three components arranged in the series- 
parallel circuit (see figure). 

Each component is either operative (1) or fails (0). However the entire assembly will operate 
iff there is unbroken path from A to B. Denote the events : 

E, : the assembly is operative, 

E, : C, has failed but the assembly is operative, 
E, : C, has failed but the assembly is operative. 
(i) List the elements of Q, Е, E,, Ёз. 

(ii) How many elementary events are there ? 
(iii) Which of the following pairs of events are disjoint : Ej, E; ; Ё, E3; Ё, E, ? 


1-51. Probability Set Function 
Let О be a given sample space and let F be a o-field associated with О. A probability 


function (or measure) P is a real-valued set function having domain F, which assigns 
to each event A є F a real number P(A) and Codomain [0, 1] and further satisfies the 
following three axioms : 

[P1] P(A) > 0, for every А є F.  [Non-negativity] 

[P2] PQ) =L, i.e. P is normed. [Normality] 


[РЗ] If A, A 


..., A, ... are disjoint events then P| UA; 


[c-additivity or countable Additivity] 
Thus the probability function is a normed measure on the measurable space (Q, F). Р 
is also called a Probability Measure. The triplet (О, F, P) is called a Probability Space 
The pair (F, P) is called a Probability Field. 
Comments. When there are only a denumerable number of possible events, say, 
О = (0, о,, ...} we may take F to be the collection of all subsets of О. However, if О 
is nondenumerably infinite, it may not be possible to define a probability measure on 
the collection of all subsets maintaining the properties [P1, P2, P3]. Every prescription 
of F, satisfying above axioms, should satisfy (1) Ø € F, О є F, (ii) А є ГЇА є ХУ, 
(11) UA; є Т, 1 <j < ©. Any collection F of subsets of О is then called o-A/gebra. 
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ctions (measures). Then the affine 
ability measure. 


Example. Let P, and P, be probability fun 
combination a,P,(A) + a@,P,(A) = P(A), say, is also a prob 


[Affine combination satisfies : a, > 0, ©, > 0, a,'+ 0; = |. True even for a, 2 Uy = |, 2, 

„апа La, = 1, 1 <j < o] 

Solution. Given P(A) = a,P,(A) + a,P,(A), setting A = 5 Dd S 
P(S) = aP (S) + aP (S) =Q +0, = | [Р (5) = by hypothesis] ШШ) 


Now P(A) = a, P(A;) + a,P(A)). So 


PG ^) а, Jis Abe ABA) 


zh hA) eas] E PA) [P, and P, are probab. functions] 
jal j=l | 


Ya A (A;) + Y a, P,(A,) 
j= j=l 


Ую, A) +a, (А) = > PD Бу Cid] 
j= j= 


Thus PEE A) = »P(A)), Гел 


All three axioms : (i) Non-negativity, (ii) Normality, (iii) o-additivity, are satisfied. It 
follows that P defined by (i) is also a probability measure. 


Extension. Let P, l Sj < o be probability measures. Then the affinine combination 
Уо, P(Aj) is a probability measure, where a, 2 0, V; and Ха, Bed «e ob, 
[The result follows as above]. 


1-52. Some Consequences of Probability Axioms 
We assume an unidentified probability space in the following results : 


1. Р(@) = 0. [The probability of an impossible event is zero] 
Proof. Since Ø € F, Р(@) is well defined. Let AE md. 


. . Then A, are certainly 
disjoint and A, 0 A, О ... = Ø. Now by o-additivity ] 


P(g) =P(A, БА 0.) = 2 P(A)= lim 2 PO) = P(Ø) lim n. 


If P(Ø) # 0, this result provides lim n — 1 as n — оо, which is ab non | 
һауе Р(@) = 0. Surd. Hence we must 
Comments. P(£) = 0, but if P(A) = 0, A need not be impossible. The event A has zero 
probability not because it is impossible, but because m UTI чуи as + : 
of equally likely experimental outcomes. Ер ШШЕ nume 


ely pou [Consult $1-56 Example 1] 

2. Finite-additivity or Sub-additivity. If A,, A,, ..., A, are disjoint events. then 
P(A, U A 0... © A) = PA) + Р(А,) +... + P(A,) | [P3'] 
Proof. Let A; = Ø, for j = п + 1, n + 2, ... Then, the events A; i= 1, 2, ... are disjoint and 


A, U A, U UU A,- АСА, АЧА ВА d. 
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КОРА OA, 0... БА |= PIA, OA, 9... OA, OA,,, 9... | 


We apply [P3] to the R.H.S., also use P(@) = 0 and obtain 

P{A, ЈА, U... UA,)} = P(A,) +... + P(A,) + P(2) + P(D) + P(A,) + PIA,) + ... + PIA) 
This establishes the finite additivity of Probability function When n = 2, P(A t3 B) 
= P(A) + P(B). 


3. Subtraction Law. If A and B are any two two events in sample space 5, then 


P(AB) = P(A) - P(AB) 


Proof. We write A = (ABUAB). [See Euler-diagram p. 3] So 
P(A) = P{ABUAB}=P(AB)+P(AB). (Бу P3] 
P(AB) = P(A) - Р(АВ). [Note : AB = A - B] 
Cor. 1. Negation or Complement Rule : P(B) = 1 – Р(В)_ 
Таке А = 5, SNB = B. 
Cor. 2. Monotonicity. If B с А, і.е. В is a sub-event of A, then A П В = B, the above 
result gives 
P(A-B) -P(A)-P(B. [BcA] (i) 
Since P(A — B) = 0, [by P1] it follows from (i) that P(A) > P(B). Thus 
BcA => Р(В) < P(A). 

Cor. 3. Supremum and Infimum of Probability Values : 
For any event А: 0 < P(A) < 1. [Probability Scale] (11) 
Proof. By axiom P1, P(A) > 0. Also P A) 20 ie. 1-P(A)>0 = Р(А) < 1. 
Combining results yield (ii). 
Cor. 4. P(AB) – P(A) P(B) = P(A’) P(B) – P(A'B) = P(A) P(B") - P(AB’)  P(A'B) - P/ADPGT). 
Proof. Since Р(А’'В) = P(B) - P(AB) and P(A') = | — P(A), etc. hence 

P(A’) P(B) - P(A'B) = [1 – P(A)] P(B) - (РСВ) - P(AB)] = P(AB) ~ P(A) P(B). 

P(A) Р(В") – P(AB’) = P(A) [1 — Р(В)] - [P(A) ~ P(AB)) = Р(АВ) — P(A) P(B). 
P(A'B') - P(A’) P(B')= (1 – P(A U B)] [1 = Р(А)] ET = P(B)) = P(AB) ~ P(A) P(B). 
[by 1-52(6)] 

4. Countable Partition Property. 1f (Aj, Аз ...‚ A,] forms a finite partition of the 
sample space S, then for any event Вс 5, 


P(B) = Ў,Р(ВА). 
—— Ч — 


Proof. Since B = ЎВА). so 
j=l 


P(B) = pan ay} Ўрвл) thy P3 
i=l is 
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Comment. The result holds for a countable Partition {A,, A, ..., М. s-}, sinc 


B= U(BNA,) and 


iz] 
P(B) = {Gena} = > P(BA,). 
i=] i=] 
Cor. If S is a discrete sample sapce (finite or countable) with elementary events е, 
k = 1, 2, 3, ... where e, has probability P(e,), then for any event E C 5, we have 


P(E) = У P(e, ). 
e, EE 
Proof. Treat sets of S as the elementary events themselves i.e. (ej, 6), ...‚ €p --.) is a 


partition of S. 


| еее 
Obviously, е, ПЕ = p s ү po Thus, P(E) = У P(E(le)- У Ре). 
k : e; ES e, €E 


5. Union of Two Events: P(A U B) = P(A) + P(B) — P(AB). 
Proof. Write (A U В) = A AB and apply finite-additivity [P3'] to get 
P(A U B) = P{Att AB} = P(A) + P(AB) = P(A) + P(B) – P(AB), [by 4] 
6. Union of Three Events : 
P(A U B UO =[P(A) + P(B) + Р(С)] - [P(AB) + P(AC) + P(BC)] + P(ABC). 
Proof. Replace B by B U C in 2-events union formula to get 
P{AUBUC} =P(A) + Р(В С) – Р(АВ UAC) 
= P(A) + [P(B) + P(C) – Р(ВС)] – [P(AB) + P(AC) - P(ABC)] 
= ) P(A) – XP(AB)- P(ABC). 
Note. For 4 events A, j= 1, 2, 3, 4 we often write 
S, = EP(A). [4 terms], 5, = XP(AAj), [6 terms], S, = XP(AAA,, [4 terms] 
S, = P(A,A,A3A,), [one term]. Then 
P(L) = Р(ОА) = S, = 53 + 5, – 5,. 
7. Probability of Exactly One of the Two Intersecting Events : 


| P(AAB = P(A) + P(B) — 2P(AD). [AA B= AB Ù AB] 
Proof. P(A A B) = P(ABUAB)- Р(АВ) + Р(А В) [by P3' : finite additivity] 


= [P(A) - P(AB)] + [P(B) — P(AB)] = P(A) + P(B) -2P(AB). — [by 4] 
Note. Given two events A and B, there occur 12 probabilities : 
P(A), P(A), P(B), P(B), P(AB), P(AB), P(AB), P(AB), P(AU B), P(A UB), P(AUB), P(A UB). 
However, only 3 can be chosen and the rest can be had through formulae. 
1-53. Poincare’s Formula and Inequalities 
With usual notation 


P(L,) = $ - 5, + 53 – ... + (-1)"* S, (1) 
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(-1)' P(L,) x C1)’ [S, — 5, + S,-... (71 * 5] (2) 
[é.g. P(L,) € Sy P(L,) 2 S, – 5,, P(L,) < 8, - 9, + 5,, ...]. 
Proof. For economy of notation we set 
P(L,) = P{A, UA, U... UA,} = P(At least one of A,, ..., A, events occurs}, 
Shawn, >. P(A, A, ...A,),1Srsn 


i <i, € .. <i, 


Н, = Bo ly Ig mh; [/, = Indicator of event А] 


d «e«t 


үз " l, if at least one event Aj occur 
[MCA па ad^ H otherwise | 


=] -|! 2.1, р 2.T, l; — FG sta. [on multiplication] 


1< ] 


А ЖЫП, а CN dl б) 


Expected value of this result, using EQ, ) = P(L,), E(H,) = S, gives 


ра.) =S,-S,+S,-..+(-D"* А S, (Poincare’s formula) 


Now recall the well-known combinatorial identity : 


uo AE T i) 


[Just obtained on equating coefficient of x * ! on both sides of (1 + ху (1+ К, = x(1 + х h] 
We now transfer r terms from the R.H.S. of (i) to its L.H.S. to get 


MEE o EE ort GH, } 
or CDN, чн +Н, жены H,} = Р = Hes Ee en Жаба 1214 (п) 


Now suppose that exactly k of n events A,, ..., A, occur. If k < r, the R.H.S. of (iii) is 
zero. If k » r, the contribution by the terms in R.H.S. of (iii) is 


k k п-г+1 [К k-1 Y 
BERT LS (i = | Ё )>0, [by (11)] 
Hence, no matter how many of the events A j occur 
САУ Е, - HL + Н, =|)" Hi) ЕЖЕН Н; 6-0) А 20 


i.e. (=) EM,- > (-1)' ЕН - H, * H-..- (-1y*' A} 
= (-1)' P) z (-1) [S - $ +... + (1)"*' (81, 
Note. m mds s ME)SS. [Boole's Inequality] 


Extension of Poincare's Formula : 


Let L, denote that at least r of the events A,, ..., A, occur and E, denote the event that 
exactly r of the events occur. Then 


P) = Ўр (1) 8, каз» £ cv" (Js. 
kar 


kr 
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е o ааттыыр it 


Note that E, = L, — L, „ ,, so that, P(E,) = P(L,) - P(L,, y. The following Rider obtains 
these results When n= 3, and0<rs3, 


1-54. Useful Formulas about Three Events 
Let A, B, C be three arbitrary events, and denote 
S, = P(A) + P(B) + C, 5, = P(AB) + Р(ВС) + PAO, S, = Р(АВО). 
Let E. L, and M, denote ‘ DENT: r events occur", "at least r events occur" and "at 
most r events occur". Find P(E,), P(L,) and P(M,) for r = 0, 2,4. 
Derivations. (a) Firstly, we observe that, 


P(ABC) = P(BC) - P(ABC) = Р(ВС) - S... 11) 
P(ABC) = Р(АП\ВОС)=Р(А)- P(ABUAC) = P(A) + P(BC) - S, + 53. (X) 
(i) E, = ABC, so that E) = 1- PA UBU O = 1-5, + 5 – 53. 
(ii) E, = ABCUABCUABC 
P(E) = Р(АВС) + P(ABC) + P(ABC)=S, – 25, +35, [by (2)] 


(iii) E, = ABCU ABCU ABC 
P(E) = Р(АВС) + P(ABC) + Р(АВС) _ 
= [P(BC) - $4] + [P(AC) SpA: ls — 3S,.[by (1)] 


wera RA TIRE m ee 


(iv) E, = ABC, so that P E,) = P(AB 
3 k 

(Б) Since PIL) = >. Р(Е,), Мм-м) ...(3) 
jak t= 


РП = E P(E,) = P(E) +...+ Р(Е,) = 1. 
PS) c x P(E,) = P(E,) + P(E,) + Р(Ез) = 5 – S, + S, 
P(L,) = > Р(Е,) = P(E,) + P(E) = S, — 253. 
P(L,) = Е P(E,) = P(E3) = 83. 


P(M,) = Y Р(Е,) = P(Ey) = 1— $ + S, — $3. 
{=0 


P(M,) = y. P(E;) = РЕ) + PC) =1- S, + 253, 
i=0 
рм, = È PE) = РЕ) + PO + РО) 1-8 


P(M,) = r P(E,) = P(Eo) +... + Р(Ез) = 1. 
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1-55. Some Additional Probability Formulas 

1. Probability of Exactly m of the N Events. The probability that exactly m unspecified 
events among the N events A,, A», ..., Ay occur simultaneously, written Р or P(E), is 
given by 


sz y m {К S, = 2. P(A а. Ж ) (| 
P(E) = Xcp MP | T en m j ,?. ) 
Proof. Let E, = UA, Aj, e Âj Аът: Ару 
where the disjoint union is over the "d possible subsets И, = (jj, j} ·.., Jm} of size m 


chosen from the integer set W = (1, 2, ..., N). The indicator form of the above events, 
with obvious notation : 


In 


Nem ОНУН), 151 AEA A п X Cn Z 
Dll, 


Here H, = УІ, і, .1,, and in it the summation is over all r-elements subsets T,, of the 


set W — №. We rewrite : 
N-m 
KE.) = 2 (Ty 2,1; lj Zr „21 м 
The set {И 7.) = (jy. Jo. s Joe fi to, «+ f,) 18 Just a subset of size m + r of the integer 
set W since T, (| W,, = ©. However, some of these sets will be identical because the /'s 
and i’s assume all values 1, 2, ..., №. The number of repetitions of a fixed set, like (W, , 
T,} is just the number of different ways " * !C, of dividing (И, 


containing m and r elements. Hence, reindexing 


N-m 
KE,) = x (-1) Ei] кы.» 


WE 


m? 


Т.) into two sets, 


where И, , „= (Jj, Jo» «> J +m} 15 a subset of size r + m of the integer set W. Putting 
m + ғ = К, the above result reads 


N k-m 
- X (0 a Eat МЕИ (0) 
Taking expectations of both sides, using EQ) = P(A,), etc. we get the stated result : 
Р(Е,) = - х6 y^" (F)s,. (1) 


Cor. ы od = Sa- "i 


s=0 


i Maz 


[x : arbitrary variable] where J, = 2l; ll; :Jo =1) 


Proof. From Eq. (i), we recover 


ls Èc piz Ыы, 
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Multiplying this equation by х’ and summing over r we get 


po arcs [Eco (фу |һ- X POMPE NO 


r=0 | л= ғ im. di "ate 
м N АК. 
where we have used: Y, Уа; = У У а. 


1 Р iz0izj i20 j20 
Using Binomial expansion we sum up the inner expression in (11) to get 


N N k 
Zz lax. = E c-n»( )^. 
r=0 k=0 r 
2. Probability of atleast m among the N Events. The probability P(m) or P(L,,) that at 
least m (1 € m < N) unspecified events of the N events Aj, Аз, ..., Ay OCCUT, is given by 
= к-т k-1 
PL). = У C3 oo 262) 
р k=m m -]1 
Proof. Since L, = m tt E, i g wa wv E hence P(L,) = P(E,) + PE. p +... + PIE). 


Using formula for P(E,), this begets us 
N 


Мы» ys + X com S e X EDM) 5, 
r=m ГЕ PIN. 


The coefficient of S, on the R.H.S., is C,, where 
C, > Сй ле [8 “j Ey ) * Ld. 3 БОДА, (0) 


Using Pascal relation : m cond [increase head by 1, take greater tail] the 


а- 1 
above gives 


с, = ex f(D) (HCCC) 
= erc өчү; 


all other terms cancel in pairs. 


=m 


3. Triangle Inequality : P(A A C) < P(A A B) + P(B A C). Lg] 

Proof. From point-set algebra for symmetric differences A A C c (A A B) U (BA C). 
P(A ^ C) < P((A A B) О (BAC) = PIA AB) + P(B A C) 

where we have used Monotonic Law (p.18) and finite additivity. This proves the truth 


of (1). 
Note. If we interpret P(A A B) as the probabilistic distance (metric function) between 
nd B, then relation (1) is the usual triangle inequality. 


N E k-m k-1 
PL) = E6S- X cv С. 
m "cw k m-l 


the events A a 
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4. Boole’s Inequality : If A,, А„ .., A, are arbitrary events (A; є F), then 
P(A,UA,U ...UA,) < P(A,) + Р(А,) +... + P(A,): mm 
Case of countably infinite number of events : If Aj, А,, ... are arbitrary events, then 
P(A, UA,U...UA,U...) < P(A) + Р(А,) +... + P(A,) +... Жел, 
Proof. We observe that | 


AUBUC=(AU AB U ABC), 
and in genera! 


A, UA, U X UA, = АО АА, JAAA Gad A, TU Ay 


К P(A,UA,U...UA,) = b 


PAA AT ANE Y Р(А,). 
p= 1 к=! 

If we let n — oo, the above yields (2). 

The result also follows by Mathematical Induction. 


Comments. Max(P(A), P(B)} x P(A U B) x min (1, P(A) + P(B)}. 


5. Bon-ferroni’s Inequality : If A,, A,, ..., A, are arbitrary but compatible events, then 


P(A, A, ...,А,) > P(A,) + P(A.) +... + P(A,) - (n - 1). at) 
_P(A,, Ay, ...,А,)2 1- P(A)- P(A))-...- P(A,). 


Proof. We use Principle of Mathematical Induction. For n = 2 

P(A,UA,) =P(A,) + Р(А,) - P(A, Aj). 

P(A, UA,) <1 => P(A,Aj 2 P(A,) + P(A,) – (2 – 1) пб) 
Thus, (1) is true for n = 2, and this starts an induction process. We now assume that (1) 
is true for 2 € n =k; then 

P(A, As, ..., A) 2 P(A,) + P(A,) +... + P(A,) – (К - 1) w(i) 
Write A, ... A, = B, then A, ... Ay, у= B,, , 7 B,(1A,, |, and use (i) to events B, and A 
to obtain 
РБ, А р) 2 PCB) + P(A, 1) – 2- 1). 

Using (ii) this becomes : P(A, Az, ..., Ay D 2 P(A) +... + P(A,, ) -— (A + 1) - 1). 
This shows that the result is true for n = k + 1. As such the process of induction is 
complete and the result is completely established. 


Comments. тіп {P(A), P(B)) > P(AB) > max {0,1— P(A)— P(B)}. 
min IPAE PODEREA Sitian (ORCA) — Р(Й у), 


1-56. Worked-out Problems 

Example 1. A pointer is spun on a fair wheel of chance having its periphery labelled 
from 0 to 100. Describe the sample space for this experiment, and find the probability 
that the pointer stops between 45 and 67. What is the probability that the pointer will 
stop at 93 ? 


spun- votate, vevdlve 


k+! 


30 emen bability : Basic Concepts — 
= T The probability of the pointer 


(ui Hon. Hess. sample аре ИНН a — a)/100, [because the wheel is 


falling between any two numbers a, b, (b 2 a) is p = (b 
fair so probability is uniform], so here p = (67 — 45)/100 = 0.22. 
Obviously P(X — 93) = 0, because the number 93 is only one o 
numbers in sample space 5. i 
Note. The assumption : p = (b ~ a)/100, satisfies the usual axioms. Since b 
[РІ]. When a = 0 and b = 100, p = 1, [P2]. By breaking the wheel's periph M 
contiguous segments, C, — (9 ЖҮ Кре m (n) 100/N, л = 1, gs, 

we find that P(C,) = 1/N and thus for any М. 


N N N 
к Өс.) * YPC I=> (1)-i- 0. [P3] 


nzl nel nzl 


f infinite number of 


ED, p20, 
ery into N 


Remarks. For continuous r.v., X, let 
Ax) 2/20) 0 <x €2z1 | then 


Pla-8<X<a+8}= [52-5 
e n T 


PIX 2G)«- lim P(X -a < X <a 6) - 0. 


However, event (X = a] is not impossible; i.e. P(A) = 0, even though A = Ø. 
Comments. Discrete events can occur on continuous sample spaces even if their 
probability is zero. The infinite sample space has only one outcome [e] satisfying 
such a discrete event, so P{e} = 0, although (e) = Ø. 
Similarly, events with probability 1 may not occur. For instance, for the wheel of 
chance the event E = (all numbers occurring except the number x,} satisfies P(E) = 1, 
although Е # S. 

| / Example 2. Events А and В are such that A U В = S. Prove 


Pto є AB} -P(o eA] P(o «e Bj] - P(o e A} P(o e B). bey 
Solution. Write P(A) = p,, P(B) = р, P(AB) = p, and then P(A U B) = P(S) give 
P(A) + P(B) – P(AB) = P(S) > p,t+p,=1+p, „(23 


P(o€A) = P(o єАВ}= р, – р 
P{w є В} = P(o єАВ}= р – p, 
R.H.S. of Eqn. (1) = p, P2 – (P2 - P3) (р - P3) = Ру ру + рур = ру 
= pp, + Pa) ~ P3 = P3 (1 + ра) - pj, [by (2)] 
=p, = L.H.S. of Eqn. (1). 


Example 3. A and B play a game in which their chances of winning are p and q, 
(p + q = 1). The first player to win 6 rounds is the winner and takes the stakes. The 
game gets interrupted after A has won 5 rounds and B has won 3 rounds. How should 


the stakes be divided ? 
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Solution. A tree diagram is suggestive of a good approach. 


P(W,) =1-P(W,) = q (Obvious from tree diagram as well) 
The stakes are to be in the ratio: 1 – q q 
[If p = q = 1/2, fair game, then stakes are in ratio 7 : 1] 


A could win round 6, just after round 5 or after a single failure or after two failures. Hence 
FW) = РА ОЕА, О F, A, = P(AQ + PC) PA + PO) PA) 
2 К 2 3 3 
=р+ар+ар=р(1+9+9) = р(1-94)01- 4 = 1-4. 
Example 4. Three groups of children contain respectively 3 girls, | boy ; 2 girls ; 
2 boys ; 1 girl and 3 boys. One child is selected at random from each group. Show 
that the chance that the three selected consist of | girl and 2 boys is 13/32. 


Solution. Denote the selection of a girl from group k by g, and that of a boy from 
group k by b,. Then 


E = {one girl and 2 boys} = {(g,b,b,) U (b,g5b,) О (b, b, 83)}- 
Spagna d! m "IP GC 
ра qa gag eh tobe GGG ay Phbhsi- 4473; 


P{one girl and 2 boys} = P{g, b, b,} + P{b, g, b.) + P(b, b, 83} = 13/32. 
_- Example 5. Show that Boole's inequality and the Bonferroni’s inequality are essentially 
the same thing. 
Solution. Boole's inequality applied to Arb As yields 
P(A, UA, U...UA,) x P(A) + Р(А,)+...+ Р(А,) NT 


Since A, U A, U...UA, = (A, A; .. A,)^, and P(B) = 1- Р(В), (1) yields by Negation rule 
l =P (A, As, s A, Sn — (FAQ PIA +... + P(A] 
ba PA s Aso As, he. IPEA ih? Adit cr PA,)} =n - D. ...(2) 
This is Bonferron's inequality : it allows to bound the probability of simultaneous 
event (i.e. intersection) in terms of probability of the individual events. 
Example 6. Ten tickets are numbered І, ..., № respectively, п tickets are selected, one 
at a time, with replacement. Find the probability that the highest number appearing on 
a selected ticket is m. 
Solution. Observe: P(X = т) = P((m—-1) «Xs т) 

= Р(Х < т) – Р(Х <m- 1) [Difference method] ...(1) 
Now, the probability that опе ticket has a number < т is m/N = р (say). It follows by 


independence [selections with replacement that the probability of all 11 tickets chosen 
have number < m is p". This means the probability that the highest number on л selected 
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bius Lov й р? # (т/10)". By the same logic, the probability that the highest numbei 


on n selected tickets is € (m — 1) is [(/m — 1/10]. Using (1) 
т. mt) oy a 
naam (=) | N (NY 


Problems with Solutions Provided at the End of the Text 
1*. Prove or disprove the following : 
(a) If P(A) = 1/3, P(B) = 1/4, then A(1 = Q. (b) If P(A) = 0, then P(AB) = 0 


(с) If P(A) = P(B) = p, then P(AB) < р>. (d) If P(A) = P(B), then A =B 
2*. A box contains 10 balls numbered 1 through 10. Five balls are drawn successively at 
random and without replacement. Let A be the event that exactly two odd-numbered 
balls are drawn and that they occur on odd-numbered draws from the box. Evaluate P(A). 


e ө ө ө o 
2:114,56758510 


3*. Four cards are drawn out of a well-shuffled deck of 52 cards. What is the 
probability of getting exactly two spades and exactly two aces ? 


4*. Three urns contain respectively 1 white, 2 black balls; 3 white, 1 black balls; 2 
white, 3 black balls. One ball is taken from each urn. What is the probability that 
among the balls drawn, there are 2 white and 1 black balls ? Three 


5*. An urn contains 3 red balls, 2 green balls and 1 yellow ball. These balls are 
selected at random and without replacement from the urn. What is the probability 
that at least one colour is not drawn ? 


о e LÀ 
2 green 1 yellow 


6*. A box contains 3 white and 3 black balls and a person draws out three balls at 
random. He then drops three yellow balls into the box and after shuffling draws out 
again three balls. Find the chance that the latter three balls are of different colours. 


7*. A bag contains 4 white, 5 red and 6 black balls. Four balls are drawn at random. 
Find the probability that 
(a) No ball drawn is black. (b) Exactly two are black. 
(c) All are of the same colour. (d) At least one ball of each colour. 
/ 8*. What is the probability of getting a void in at least one suit in bridge ? (That is to 
say, not possessing any cards of at least one suit). 
-/9*. mcards are drawn from an ordinary pack, with replacement. What is the probability 
that each of the four suits will be represented at least once among the n cards. 
/10*. n balls are randomly distributed among three boxes. Find the probabilities of : 
(a) No empty boxes, (b) Exactly one empty box, (c) Exactly two empty boxes. 
11*. Arrange the following in increasing order of magnitude : 
P(A), P(A U B), P(A N B), P(A) + P(B). 


12*. 


19", 
/A4*. 


_AS5*. 
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(Implication Rule). Let А, В, C be three events ‘and a assume that the simultaneous 
occurrence of A and B implies occurrence of C; then 


P(C) > P(A) + Р(В) – 1, or P(C)< Р(А) + P(B). 
If P(A) = 0.9, Р(В) = 0.8. Show that P(AB) > 0.7. 


n pairs of shoes are in a closet but the 2n individual shoes are thoroughly mixed. 
r shoes are selected at random. Find the probability that there is at least one pair 
among the r selected. 

In a lottery т tickets are drawn at a time out of the total number of л tickets, and 
returned before the next drawing is made. Show that the chance that in k drawings, 
each of the numbers, 1, 2, 3, ..., n, will appear at least once, is given by 


лы ia) n еа ар 
i ! n 2 n n-1 (з n n- 1 п-2) ~~ 


Exercise 1(c) 


If d(A, B) = P(A A B), show that d has all the properties of a metric function. 
Write A U BU C as a union of disjoint sets and evaluate P(A U B U C). Also establish : 
P(ABC) x Р(АВ) < (P(A ОВ) < P(AU BUC) < P(A) + P(B) + Р(С). 


З. Aa) If A flips n fair coins and B flips n + 1 fair coins, show that the probability that B flips 


6. 


more heads than A is 1/2. 

(b) Show that the chance of drawing 7 or 11 with two dice, each having six faces numbered 
| to 6 is 2/9. 

Irt «TT, 172; (1/2y), ..., (1/2)"}, n fixed and A = (1, 1/2), В = (0: o (1/2), j > 1 and even], 


with P(A) = 1/8, P(B) = 1/2. Show that P(A U B) = 5/8 and P(A В) = 3/8. 


Let S= (e, е, ..., e;) with p; = P{e;} assigned as : 
z 0:05, p2 = 0.25, рз = 0.10, 
ра = 0.20, ps = 0.30, pg = 0.10. 


Compute the probabilities of the events 

A= [e е, е3}, Б = (e, ез, е4, es}, C= le, е6}, р = (eg). A П В, (А П С) U B, 
(AUB)NC,(AND)U(BUC) [Ans. 0.40, 0.85, 0.15, 0.10, 0.35, i) 0.05, 1] 
A, B, С a disjoint events associated with an experiment (A, B, С}. If P(B) = = 5 P(A) and 


P(C) = 5 + P(B), find P(A), P(C), and P(A U C). [Ans. 4p, 3p, ip, р = 1/3] 


A нг i. 0«x« 10} be a sample space and define events A, = (x:0«x X2), A = (x :0«x € 4], 


={x:0<x<2)U (x:4<x< 10}. If P(A,) = 3/8, P(A,) = 7/8, show that P(A,) = 0.5. 
А Events A and В аге such that EA) = 3/4 and P(B) = 5/8, Show that 
(i) P(A U B) > 3/4, (ii) 3/8 à Р(АВ) < 5/8, (iii) 1/8 < P(AB) x 3/8. 
(b) Given P(A) = 3/4, P(B) = 3/8. Show that P(A U B) 2 3/4 ; 1/8 € P(AB) € 3/8. 
Given P(A) = 1/3, P(B) = 1/4. Show that P(A U B) > 1/3; 0 < P(AB) < 1/4. 


9. Events A and B are such that P(A U B) = 3/4, P(AB) = 1/4 and P(A) = 2/3. Show that P(B) = 2/3, 


and P(AB) = 1/12. 
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10. Examine the consistency of the following 
P(A) =0.4, P(B) = 0.3, P(C) = ОЛ; P(AB) = 0.2, РВС) = 


data : E 
0.2. РАО) = 04, P(ABC) =0.5. 


[Ans. [Inconsistent] 


11. Defects are classified as of atype A, B, C and the following probabilities have been determined 


from available production data : ` 
P(A) 0.20, ren" P(C) 20.14, P(AB) = 0.08, P(AC) = 0.05, уге E Р(АВС) = 0.02 
What is the probability that а randomly selected item of product will y 3 Bo ty pe 
of defect ? Show that probability that it exhibits both A and B type defects, but 15 free from 
type C defect is 0.06. 
12. Which of the following are probability spaces and why ? 
ау О (a, b). F= ((a), (b)}, Pla} = P{b} = 1/2. 
(ii) Q(1,2), = (0, (1), {2}, Q}, P@) = P(1) 2 P(2) =0, PQ)=1. 
(iii) Q= {a}, F= {Ø, Q} , P(O) =0, PQ) = 1. 
13. (а) A sample space S consists of three elementary events ¢,, ез, ез. Find for each of the 
following whether it is a probability model : 
(i) P(e,)=0.3, P(e,) 0.6, P(e,)=0.1 [Yes] 
(ii) P(e,) = 0.6, P(e5) 20.9, P(e,)=-0.5. [No] 
(b) For disjoint events A, B, C show that the following are not permissible assignments of 
probabilities 
P(A) = 2/3, P(B) = 1/4, P(C) = 1/6. 
^ (c) Which of the following are probability measures on the events of О = (0, 95, 04, 04)? 


[Ev | 2 | te) | toy | to) | to, on too [too [| 9. | 
| 0 alk 1 1 1 


Р, 

Р, 
14. (a) A card is drawn from a well-shuffled pack of playing cards. Show that the probability 
that it is either a spade or an ace is 4/13. 
(b) Two cards are randomly extracted from a deck. Prove that P{2 cards form a blackjack} 


= 32/663, [blackjack = an ace and an other card as ten jack, queen or king]. 

15. Acard is drawn at random from a full pack. If A and B denote getting a heart card and getting 
a face card, show that P(A), P(AB), P(A U B), P(AB), P(A UB), P(AB), P(AUB) are 
respectively equal to 13p, 10p, 22p, 3p, 42p, 9p, 43p where p = 1/52. 


16. (а) Туе ee Oe Ta eens ON getting odd sum of the points on the 
upturned faces and B denotes the event that there is at least one 3 shown, show that P(A U B). 
P(AB), P(A - B) and P(AB U A) are respectively equal to 23/36, 1/6, 1/3. 5/6. 

«9 ота, oie up beady with probability P, and coin C, comes up heads with probability 
Рэ > рі. You win a bet if in 3 tosses you get at least 2 heads in succession. You are to toss the 
coins alternately starting with either coin. What coin would you select to start the game ? 

17. From a group of 8 children, 5 boys and 3 girls, three children are chosen at random. Show that 
the probabilities that the elected group contains : 

(a) no girl, (b) only one girl, (c) one particular girl, (d) at least one girl, (e) more girls than 
boys, are respectively 10р, 30p, 21p, 46р, 16p where р = 1/56 | 


t2 


2 
ub 
4 


19. 


20. 


21. 
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P(X = 0) = 0.06, P(X = 1) = 0.24, P(X 22) = 0.35, P(X = 3) = 0.25, P(X = 4) = 0.10. Show that 
P(X 2 2) = 0.70, P(X > 2) = 0.35, P(X € 2) = 0.65. 
An urn А contains four tickets numbered 1, 2, 3, 4 and the urn B contains six tickets numbered 
2, 4, 6, 7, 8, 9. One of the two urns is chosen at random and a ticket is drawn at random from 
it. Show that the probability that the ticket drawn bears the number (a) 2 or 4 is 5/12, (b) 3 is 
1/8 and (c) 1 or 9 is 5/24. 
If A, B, C are three events and if P(A) = 0.40, P(B) = 0.55, P(C) 20.50, P(BC) = 0.25, P(CA) = 0.20, 
P(AB) = 0.15, P(ABC) = 0.05, find P(E,), PAL); Р(М,), p= 1,2; 39 where E, Ly M, denote 
exactly r, at least r and atmost r events to occur. 

[Ans. P(E,) = 0.40, 0.45, 0.50, P(L,) = 0.90, 0.50, 0.05, P(M,) = 0.50, 0.95, 1] 


(a) ; Five cards are drawn from a pack of 52. Show that the chance that these 5 will contain 
(1) just one king is 0.2995, (ii) at least one king is 0.3412. 


Ab) Cards are drawn successively from an ordinary deck, until an ace appears. Find the 


22. 


A. 


AB. 


chance that an ace appears (i) at the kth draw, (ii) after the kth card. 

Show that | P(A) - P(B) |< P(AB tt AB). 

If P(A) = 0.4, P(B) = 0.7, determine the maximum and minimum possible values of P(AB) and 
the conditions under which each of these values is attained. [Ans. 0.1 € P(AB) <0.4] 


Suppose that each of n sticks is broken into one long and one short part. The 27 parts are then 
shuffled and arranged into n pairs from which new sticks are formed. Show that 


(a) P{All parts are joined in original order} = n! 2"/(2n)!. 
(b) P(AII long parts are paired with short parts} = (n3)? 2"/(2n)!. 


(c) P(At least one of the original sticks is formed = zc-np"'() 2* (2л – 2k)! (2n)!. 


An event A of the sample space Q is called P-null if P(A) = 0, and P-sure if P(A) = 1. Establish. 
(a) If both A and B are P-null, so are AB, AU Band AB. 

If A is P-null and B is any event, then, P(AB) = 0 and P(A U B) = P(B). 

(b) If both A and B are P-sure, so are AB, AU B and AU B. 

If A is P-sure and B is any event, then P(A U B) = 1 and P(AB) = P(B). 


Find PAN C)if P(A BC) 20.1, P(A АВА C) 20.6, PIBN (AU C)] 20.3, P(ABC) =0.1. [Ans.0.2] 
A die is thrown N times. Show that, for 1 <k < 6, 


k AN 
P[Each of k given faces appears atleast once} = Y cp (5) (1 - z) 
r=0 


Let (Q, F) be a measurable space and let Р, P», ..., P, be a sequence (collection) of probability 
measures defined on F. If a, 2 0, i= 1, 2, ..., n are real numbers such that Ya, = 1, then the 
function P defined on by the relation. 

(a) P(A)= Xa, РКА), (b) P(A) = X(1/2)" P(A), n= 1,2, ..., oo 

is a probability measures on F. 

Suppose that the probabilities P(A,), P(A,), ..., (A, are known and that A,, A,, ..., А, forma 
partition of Q. Show that it is possible to calculate the probability of any member of F (the 
field of events). 
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1-60. Conditional Probability | 
Let C be an arbitrary event in a sample space О with P(C) » 0. 
The probability that an event A occurs once C has occurred, or, in 
other words, the conditional probability of A given C, notated 
P(A | C), is defined by : 

PACC. = Р(А П СУРО): 
Іп a certain sense, P(A | С) measures the relative probability of A w.r.t. the new sample 
space (the reduced space) C. (See Fig.). If Q is an equiprobable space, then 


P(Af1C) = п(АС)/п(О), P(O) = n(C)/n(Q). 


Reduced sample space 


Number of ways both A and C can occur 


P(A | C) = n(AC)/n(C) = Number of ways C can occur 


Example. A family has two children. Find the probability p that both children are 
boys if it is known that : (i) One of the children is a boy, (11) The older child is a boy. 
Solution. Here Q = {bb, bg, gb, gg}. The reduced space is 

(i) C = (bb, bg, gb), so p = 1/3. (ii) C = (bb, bg), so p = 2/4 = 1/2. 


1-61. Conditional Probability as a Genuine Probability Measure 
To show that the conditional probability function P(* | C) satisfies the three axioms of 
Probability Theory. 
[P,] 0. РАО) s [Pd o 1 С) =, 1 
[P4] P((A, UO A, U Hc) РА т P{A,(C)} +... 
Proof. (1) Since A(|C c C, we get PAC) < P(O. Thus, 
P(A | C) = P(AC)/P(C) < 1, and is also non-negative because P(AC) > 0 and P(C) > 0. 
(2) Since S П C = C, P(S | С) = P(S N C)/P(C) = P(C)/P(C) = 1. 
(3) IfA; ПА; = Ø (i + j), then (А, ПОПКА ПО = Ø, so A.C and АС are disjoint events. 
Now, 
P(A, U A, О.П C} = Р{А,С U AC U ...} = P(A,C) + P(A,C) +... 


РКА GA U.)01€] _ PAO , PAC) |-. PONG _ | 
быы. Oe ae TENET HS А 


or PALO A, U .)1I C] = Р(А 1С) + Р(А, 1С) +... 
Comments. Since P(* | C) is a non-negative normed measure and is also c-additive, it 
follows that P(* | C) must satisfy any consequence of the usual probability axioms ; e.g. 


P(A U BI ©) = P(A | C) + P(B | C) – PABIC), P(A | C) < P(B | O; if ACB. etc. 
P(B | A) = P(AUD. P(B) 
P(A) 


As P(BIA) = FE Р(А1В) = ee 


2 P(AB) = P(B | A). P(A) = P(A 1 В). P(B). 
Thus Product Rule yields the Reversal Identity readily. 


Reversal Identity : 


$1-63. Worked-out Problems mA ӨТ. 


1-62. General Product Rule 
For arbitrary events А, A», ..., A 


P(A;, A^, .... A,) = P(A,) P(A, IA) P(A, ТАЈА,) ... P(A, 1А, А, ..., А, 1). (0 
Proof. Since A, 2 АА, >... 2 A, A,, ..., A,, we readily obtain, by Monotonicity : 
PU = PUMP) с. = P(A), Алт.) > 0. 
It follows that all the conditional probabilities in (1) are well defined. We now use the 


method of mathemetical induction. The result is true for n = 2 [trivially from the definition 
of conditional probability]. We assume that the result is true for 2 € n = m; hence 


PA А.-А =P(A,) P(A, | A) P(A, ТА Ay) PALLAS А es А-1) (0 


From: X P(BA,,,) =P(B) P(A,,, ,| B), with B =A, A; ... An we get 
КОЕ A, yA, ПЕНА A,, «.. A, РА. |1 Ay, AS S An) (ii) 
SPA) P(A, TA) -.. POLL 1A, А, «.. Au i) 
ПИАТ 4) 


where (i) is inserted into (ii). This shows that result (1) is true for n = m + 1, if it is true 
for n = m. By Induction Principle, (1) is true for all integral values of л. 


P(A,A,) P(A,A,A,) PAA, 0, 09. P(A, A, a ud An) 


miner PATA, TA S= Sir IE ree А. ДА nid 
iter. P(A A, DIC АШ? PCA) si PCA AD за PGA A> А npe tt P(A) А, :..А, 2) 


= P(A) . PALA) . P(A, ТАЈА)... P(A, ТАЈА, ... А, 1)- [Def. Cond. Probability] 
Cor. If events are independent, P(A, | A) = P(A), P(A; ГАА) = P(A) ; ete. and (1) 
translates to 
Р(А А, ...А,) = P(A,) P(A)) ... (A,).. AZ) 
Product Rule for Conditional Probability : 
BARTO = Р(А 1 С) Р(В | AC). [Proof trivial] 
P(A,A, ... А, 1C) = P(A, ІС) P(A, ТАС) P(A, ТААС)... P(A, AL, ... A, О). 


"ucl 


1-63. Worked-out Problems 


Example 1. In terms of probabilities : p, = P(A), p, = P(B), p, = P(AB), [p, p P3 > 0], 
express the following in terms of ру, p», ру: 


(a) P(AU B) (b) P(AUB) (c) P(AB) 
(d) P(AU B) (e) P(AB) (f) P(AB) 
(в) P(A | B) (h) P(BIA) (i) P[AQ CAU B)] 


G) PL[AU(A 1 B)] (К) P(AIB). 
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Solution. It is useful to refer to Euler's diagram [p. 3] 


(a) P(AUB) = 1 - P(A U B) = 1 - [Р(А) + P(B) – Р(АВ)] = 1 - Pp, – P2 + р,. 
(Ь) P(AUB) = Р( АПВ) =1- Р(АП В) = 1 р. 

(c) Р(А В) -P(B – АВ) = Р(В) - Р(АВ) = p; - Ps 

(d) P(AUB) = Р(Ау+ (B) - KAB)-1- p, +) (y - P971 - Di * P [by (c)] 
M P(ANB) = P(AUB)-1- pi- Pz + Py [by (а)] 
(f) P(AB) = P(A)- P(AB)= p, - P. 

(g) P(A | B) = P(AB)/P(B) = p,/p>- 

(h) Р(ВІА) = P(AB)/ Р(А) (p, - p)! (0 — р). [by (c)] 
(i) — P[AQ(AUB)] = PIAN A)U(AB)|= P(OUA B)» Р(АВ) = p; - рз. [by (c)] 
G)  P[AU(AQ B] = PI(AUB)- P(A) + P(B) - P(AB) = p, + p» — ps 

(k) P(AIB) = P(AB)/ P(B)=(1- p,— p, + p)! (1— pj). [by (e)] 


Definitions. If A and B are disjoint, p = Р(АВ) = 0. _. 
If A and B are independent, P(AB) = P(A) P(B) > P = рур». 
Several of the above results can then be simplified by these additional conditions. 
Example 2. It is felt that probabilities are 0.20, 0.40, 0.30 and 0.10 that teams of four 
zones A, B, C, D will win their final championship. For some reason, zone B is declared 
ineligible for championship. Find the probability that zone A will win the championship. 
Solution. The given data reads 
P(A) =0.2, P(B) = 0.4, P(C) = 0.3, P(D) = 0.1, P(B) = 0.6. 

We need find P(AIB). Now 
P(B) P(B) PB) - O6 7x [P(AB) = Р(@) = 0] 
Note. Since ACB,CCB,DcB, we find AB- A,CB- C and DB = D. Hence 

Р(АІВ) = P(AB)/P(B)= Р(А)/Р(В) = 1. 
Example 3. If P(A) = a, P(B) = b, then P(A | В) > (a + b — 1)/b. 
Solution. From P(A U B) < | we obtain : P(A) + P(B) — P(AB) < |. NO 
Since P(AB) = P(B) P(A | B) = bP (A | B), relation (i) reduces to 
a*b-bP(AVB)€1 = P(AIB) > (a + b – 1)/Ь. 
Example 4. If А and В are two events, prove that 

P(AMB) =[P(A) - P(AB)] / [1 — P(B)]. [P(B) # 1]. 
Deduce that P(AB) > P(A) + P(B) - 1. Also show that P(A) > P(A | В) if P(ALB)» P(A). 


Solution. (i) By definition, 
P(AMB) = P(AB)/ P(B) = [Р(А) – P(AB)]/ [1 — P(B). TN 


Р(АІВ) = 
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Using P(AIB) < 1 provides 
P(A) — P(AB) < 1 - P(B) or P(AB) 2 P(A) + P(B) - 1. 
(ii) P(AIB)» P(A) < P(A)- P(AB)> Р(А)[1- P(B) (Бу (1)] 
<> P(AB)« P(A) P(B) < P(AIB) < P(A). 
Similarly, P(AIB) < P(A) < P(AIB)> P(A). 


Example 5. Two cards are drawn at random, without replacement, from an ordinary 
deck. Find the probability of drawing either an ace or a spade. 


Solution. Write A, = Ace of spade, A,’ = Ace of non-spades and define events. 


A = (The duo contains ace or aces} = (A,A; А,А,}, А, for aces, etc. 


S = {The duo contains spade or spades} = 15,570 5,5) , S; for spades, etc. 


A N S = {The duo contains an ace and a spade} = ((A,C, О C,As) U (5, А; О А; 5,)) 
where C,, С, аге any cards, S,, S}, are spade cards. 


P(A) = P(A, Àj) + P(A, A) = (t) ed / (2) + (4) / (2) E = = 0.1493. 
P(S) = PCS, 5,) + P(S, $,)= (8) $i / (2) T (9) / (2) = 15 0412. 


P(AS) = P(A,C, € СА; + P(SIAg © А; $,} = 2Р(А,С,) + 2P(Ag! S,), by symmetry 


I 51 3 = [жр 


= 2-55-35], + 35°51 7 25 |= 0.0656. (S, has to contain no ace) 


442 
P(A U S) = P(A) + P(S) – P(AS) = 0.1493 + 0.4412 — 0.0656 = 0.5249. 


Example 6. What is the probability that (1) no two, (ii) at least two, out of a gathering 
of n people (n < 365) have the same birth date ? 


Solution. We assume a non-leap year so that О = (1, 2, 3, ..., 365}. Define the events 
Aj = {jth persons's birthday differs from all other person's birthday], / = 1. 2, ... 
N, = (No two people have the same birthday} = A,A, ... A,. (АП with different birthdays) 
Assuming equi-likelihood, writing A = 1/365, we have 

P(A,) = 365/365 = 1, P(A, | Aj) = 364/365) = (1 — A), P(A, | A,A) = 363/365 = (1 – 2А). 
Р(А АА, ... А) = (365 – j + 1)/365 = 1 -G- 1) №. 


P(N,) = P(Aj Ax ..., Aj) = P(A,) P(A, 1А)... P(A, ТА, Й АДУ 
= 1.(1-2) (1-22)... [1 = (m= 1) А = 365. 364 ... (366 - п)/(365)". 
P(L,) = P{At least 2 people have the same birthday} = 1 ~ P(N,). 


Remarks. ЇЇ n = 26, then using approximations, log (1 + x) = х, we get 
P(N) =(1 — A) (1 - 2А) (1 = 3A) ... (1 – 25А) 
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log P(N,) = Lin Ajd= logs 365 ) 72 


P(N,) =°” = 0.412. 

Thus, in a gathering of 26 poeple, the probability 
the same birthday. 
When - n =50, P(N,) 0.03, P(L5) & 0.97 
When n =23, P(N,) = 0.493, P(L,) = 0.507 
Thus, in a gathering of 23 persons, the probability that at least two of them have the 
same birthday exceeds 0.5. 
Example 7. Cards are dealt one by one from a well-shuffled deck until an ace appears. 
Show that the chance that exactly n cards are dealt in all before the first ace, is 

(51 — n) (50 – n) (49 – ny(51 . 50. 49. 13). 
If the cards are continued to be dealt until a second ace appears, show that the chance 
that exactly r cards are dealt in all before the second ace, is 

r(51 — ғ) (50 = ry(50 . 49 . 17 . 13). 
Solution. (i) Exactly n cards are dealt before the first ace means that (n + 1)th deal is 


the first ace. Thus n cards are extracted from the non-ace cards 48 (= 52 – 4) and 
(n + 1)th card is extracted from 52 — n cards. Define the events 


A = (n cards out of 48 non-ace cards}; В = {(n + 1)th card from 52 — n cards}. 


P(AB) = P(A) Р(ВІА) = (a / (2). oo 


_ 48 (52- n)! NC vlg (50 —n) (49 — n) 
= 52 (48-n)! 52-n 31750. 49; 13 
(ii) Here (r + 1)th card is to be the second ace; thus there is one ace in the first r cards. 
apo: 
— ((r — 1) cards out of 48 cards and one асе}, D = ((r 


is 0.412 that no two of them have 


+ 1)th card second ace} 


nen "nono (tyr) s 


48! (52 - г)! Жы xd _'G1-r)(50-r) 
52149 = PS ihe 50.49.17 13 


Example 8. Show that P(A) = P(B) if P(A B)= Р(АВ). 

Solution. From point-set algebra (draw a Figure) A = AB Ut AB, B= AB t AB. 
P(A) = Р(АВ) + Р(АВ); P(B)- P(A B) + P(AB), 

Hence Р(А) – P(B) = P(AB)- P(A B) 


From (1), P(A) = P(B) €» Р(АВ)= Р(А В) 


+ 


1°. 


P, 


8*. 


9°. 


09". 


M* 


12*. 
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Problems with Solutions Provided at the End of the Text 

Let P(A) = p, P(A | B) = q, P(B | A) = r. Find the relations between the numbers 
р, 9, r for the following cases : 

(a) Events A and B are mutually exclusive (m.e.). 

(b) A and B are m.e. and collectively exhaustive. 

(c) A is a subevent of B ; B is a subevent of A. 

(d) A and B are me. 

If A, B, C are possible events, prove or disprove : 

If P (A) > P(B), then P(A | C) > P(B 1 С). 

Show that if A, B, C are three events such that ABC = Ø and P(C | AB) = P(C | B), 
then P(A | BC) = P(A | В). 

Suppose B, N B, + Ø, and A, UA, с B,B,. Show that 

P(A, | Bj) P(A,1 B») = P(A, | B5) P(A,1 Bj). 

Let Bj, B5, ..., B, be mutually disjoint and let B = О, B, (1 <j sn. Suppose 
Р(В) > 0 and P(A | B) = р for j = 1, 2, ..., n. Show that P (A | B) = p. 

A coin is tossed until a head appears, or until it has been tossed three times. 
Given that the head does not appear on the first toss, find the probability that the 
coin is tossed three times. 

Two cards are drawn from a 52-card deck (the first is not replaced). Find the 
probability that 

(a) If the first card is a jack, the 2nd is also a Jack. (b) Both cards will be a Jack. 
(c) If the first card is a Jack and the 2nd card is a 10. 

A bag contains 15 items, of which 4 are defective. The items are selected at 
random, one by one and examined. The ones examined are not put back. What 
is the chance that the 10th one examined is the last defective ? 

An urn contains ten balls of which three are black and 7 are white. The following 
game is played : At each trial a ball is selected at random, its colour noted, and it 
is replaced along with two additional balls of the same colour. What is the 
probability that a black ball is selected in each of the first three trials ? 

The face cards are removed from a full pack. Out of the remaining 40 cards, 4 
are drawn at random. Find the probability that : 

(a) They belong to different suits. 

(b) They belong to different suits and different denominations. 

Compare the probability of at least one six in 4 tosses of a fair die with the 
probability of at least one double-six in 24 tosses of two fair dice. (Chevalier de 
Mere Problem). 

A bag contains 50 balls of which three are black. The balls are drawn in succession 
(without replacement) from the bag. Find the chance that the first black ball is drawn 
at the rth draw. How is the probability changed if each ball is replaced before the 
next draw ? 
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What is the chance that at least one of the players in a bridge game gets a complete 


suit of cards ? 


. Define equivalent events. Prove that P(ABC) = P\A EE Ше events A, В, 


C are equivalent. 


Exercise 1(d) 

(a) Given P(A) = 1/3, P(B) = 3/4, P(A UB) = 11/12, show that P(A | B) equals 2/9 and P(B | A) 
equals 1/2. re 
(b) Given P(A) = 1/4, P(A | B) = 1/3, P(BIA) = 1/2, find P(AIB). 
(c) Given P(A) = 1/2, P(BU A) = 3/5, find P(B) if P(A | B) = 2/5. 

If P(A) = P(B) = 1/2, show that P(A | B) > 1/2. 
(e) If P(B)= P(A | B) = Р(СТАВ) = 1/2, show that P(ABC) = 1/8. 
(f) An experiment resulted in six outcomes ер. €5, ..., e, With respective probabilities 0.1, 0.2, 
0.3, 0.2, 0.1, 0.1. IfA = (е, e3, e4}, B= (е, ед, е) and C= {e,, e, ez} show that (i) P(A U BU 
C) = 1, (ii) P(A | B) = 2/5, (iii) P(B | АС) = О. 
(а) Show that P(A | BC) P(B | C) = P(AB | C). : 
(b) If B and C are subevents of an event A, show that P(B | A)/P(C| A) = P(B)/P(C). 
(c) Suppose that B c C with P(B) » 0. Show that 

(i) P(A | B) = P(AB | CUP(BI C), «atf 1t P(A I Су = 1, then P(A 18) = 1. 
(d Show that P(A) + P(B)> 1 => P(BIA)>1— [P(B)/ P(A)]. 
For the possible events A and B, establish the following : 
(a) P(AIB)z P(BIA) = P(A) = Р(В). (b)P(AIB) = P(A) © P(B |A) = P(B). 
(c) P(A |B) > P(A)  P(BIA) > P(B). (d)P(AI B) < P(A) = P(BIA) < P(A)(£) 
Note. We say : B is favourable to A if P(A | B) > P(A) and B is unfavourable to A if P(A I| B) < 
P(A). Thus, B carries positive information about A if P(A | B)> Р 
information about A if P(A | B) < P(A). 
Part (c) says : B is (unfavourable) to A iff A is (unfavourable) to B. 


(oh Prove or disprove : If P(A | В) = 1, then P(ABC) = P(BC) for any event C. 


(A) and B carries negative 


(b) For independent events A and B, let P(AB) =x, P(AB) = у, where0 x x, y x x * y € I. Find 
p = P(AB). State additional restrictions on x, y if any. 

(a) ТАГ B= Ø, then 

(i) P(AIB) = P(A)/[1 – P(B)], P(B) + 1 

(ii) Р(АТА 9 B)=P(A)/[P(A) + P(B)], P(A Н B) #0. 

(b) Show that P(A | В) > 1 - P(A)/ P(B). 


Show that the estimate of P(A | B) from above and from below given that 
P(B) = 1 ~ £, where є is small is (p ~ е)/)(1 – €) € P(A | B) € p/(1-— е). 
(c) For n events A,, A,, ..., A, with conditioning event В, P(B) » 0, show that 


1D) > Y P(A, В) – (n — 1). 
i=! Г 


P(A) = p, 


10. 


‚^з. 


a3. 


14. 


15. 


16. 


17. 
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Suppose B,j=1, 2, 3 are m.e. events with P(B,) = 1/3. If P(A ІВ) = 7/6, then P(A) = 1/3. 

An electronic assembly consists of two sub-systems, say A and B. From previous testing 
procedures, the following probabilities are assumed to be known : 

P(A fails) = 0.20, P(A and B fails) = 0.15, P(B fails alone) = 0.15. Show that : 

(i) P(A fails! B fails) 2 0.50 (ii) P(A fails alone) = 0.05. 

Let A, B, C be three events such that : 

P(A) = 0.3, P(B) = 0.4, P(C) = 0.5, P(AB’) = 0.2, P(BC) = 0.3, P(A'B'C') = 0.3, P(AB | C') = 0.1. 
Find P(B' ІС"), P(A | B) and P(A ІС"). [Ans. 4/5, 1/4, 3/10] 
The probability that a man purchases brand A or B of cigarette is 0.5 and 0.3 respectively. He 
purchased one of the two brands on a particular day. Show that the probability that he 
purchased A is 5/8. 

In a class there are 13 girls and 14 boys. Two students are selected one by one without 
replacement for the recitation of a lesson. Show that the probability of selecting a girl on the 
second occasion given that 

(i) a boy was selected on the first occasion is 7/27. 

(ii) a girl was selected on the first occasion is 2/9. 

A bag contains 6 balls of different colours and a ball is drawn from it. A speaks truth twice out 
of 4 times and B speaks truth 7 times out of 10 times. If both A and B say that a red ball was 
drawn, show that the probability of their joint statement being true is 35/38. 

Urn A contains 3 black and 2 red balls and urn B contains 4 black and 6 red balls. Urn A is 
selected with probability p and B is selected with probability q (= 1 — p). Find the value of p 
that makes the probability of getting a black ball the same as if a single draw is made from urn 
C that contains 7 black and 8 red balls. 

(a) A bag contains 3 white and 3 black balls. They are drawn successively (i) without 
replacement, (ii) with replacement. Show that the chance that the colours alternate are 1/10 
and 1/32. 

(b) A bag contains 10 white and 6 black balls. 4 balls are successively drawn out and not 
replaced. Show that the probability that they are alternately of different colours is 45/364. 
A person takes 4 tests in succession. The probability of his passing first test is p, that of his 
passing each succeeding test is p or p/2 according as he passes or fails the preceding one. He 


qualifies provided he passes at least 3 tests. Show that his chance of qualifying is p^ + 3 pq. 


(a) A student is to appear for two tests in which his respective chances of winning are 0.5 
and 0.7 and losing both the tests is 0.2. Show that the probability that the student will win the 
test-2 when he has already won test-1 is 0.80. 

(b) A and B are two very weak students of mathematics; their chances of solving a problem 
correctly are 1/8 and 1/12 respectively. To a given problem, they obtain the same answer. If 
P {common mistake} = 1/1001, show that the chance is 13/14 that their answer is correct. 
The sample space consists of the integers from 1 to 2n, which are assigned probabilities 
proportional to their logarithms. Find the probabilities and show that the conditional probability 
of the integer 2, given that an even integer occurs, is log 2/[n log 2 + log n !]. 

A man forgets the last digit of a telephone number, and dials the last digit at random. Show 
that the probability of calling no more than three wrong numbers is 0.3. 
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18. 


19. 


20. 


22. 


23. 


(а) An urn contains 2 black, 3 white and 4 red balls. We draw one ball at random E put it 
“тө Then we draw the next ball and so on, Show that the probability of drawing at first two 
any . al ; Е а К я БЕ A 260. 

black balls, then three white ones and finally the red ones 15 1/1 

black balls. When two balls are randomly extracted, the 


x contains w white and b E^. 
(9) ^ Sor PET Show that min w = 3 and that if b is even, 


probability that both are white is given to be 1/2. 
min w= 15. Find also the min (w + b). 

A bowl contains 10 chips. Four of the chips are red, 
taken at random and without replacement, prove that the chance th 
colour relative to the hypothesis that there is exactly 1 red chip amon 


A drawer contains 8 pairs of socks. If 6 socks are taken at random and without replacement, 
show that the chance that there is at least one matching pair among these 6 socks is 111/143. 


A lot of 100 items undergoes a selective inspection. The entire lot is rejected if there is at 
least one defective item in five items checked. Show that the probability that the given lot 
will be rejected if it contains 596 defective items is 0.23. 
A loaded die is tossed once. If x is the result of the toss, then P(X =k) = p, 1 Sk € 6. 
If X =k, a coin is tossed k times. Find P(X = odd | at least one head occurs]. 
A supplier of a certain testing device claims that his device has high reliability inasmuch as 
P(A | B) = P(AIB) = 0.95, where A = (device indicates component is faulty} and 
B — (component is faulty]. Device is to be used for locating faulty components in a large 
batch of components of which 5% are faulty. Show that P(B | A) = 0.5. 
If we want P(B | A) = 0.9 and let P(A | B) = Р(А1В) =p, how large does p have to be. 

[p = 0.9942] 


5 are white and | is blue. If three chips are 
at there is | chip of each 
g the three is 1/3. 


1-70. De-Moivre's Problem on Dice Points 


Given n dice, each with f faces marked from 1 through f. These are thrown at random. 
The chance that the sum of the numbers exhibited is ‘s’ is given by 


Р, = Coefficient of х“ in (x! + х2 +... + A'A". sisi) 


Proof. Since any one of the f faces may be exposed on any one of the n dice, the total 
number of points constituting the sample space is f" [Product Rule]. 

Since the coefficent of x° in the multinomial expansion of (x + х2 + ... + x^)" arises out 
of the different ways in which n of the indices 1, 2, ..., f can be taken so as to yield the 
sum $, it follows that the number of ways favourable to get sum S is the coefficient of 
x' in the said multinomial. Hence, the probability sought is that given by (1). 


Cor. Р, = Coefficient of х* "in (1 & x +... ж x 7)" 


ГОМОРРА ЕРА ОР sii, 


mcum б 
eee co i M SC Con oor di oU MR т 
F, r=0 r! ӘК у 


Extension. Given п dice, with faces fj, f^, ..., f,, then 


Р; = Coefficient x? in 


(аж! xy ar a I yee ee ee py 
кыйы aR As EA oio COLE чйр A C MB RNC osi AN 


Nisin y, 


The proof is smilar to (1). 
Remark. De-Moivre's Problem can be more naturally handled by Generating Functions. See 88-50. 


$1-80. De-Moivre's Problem of Points 4 5 
Case of Two Cubical Dice : 


" me ,642 
p, = Coefficient of x* in NE ae MEE A КЄ 12 
(6) 
=A. Coefficient of x 2іп (1 + x & ... + xy, [A = 1/36] 
= À . Coefficient of x* ^ ^in [(1 — х°)/(1- p = (1- xy. (12 x) : 


=. Coefficient of x* 2 in (1 - 228 x) (Xr + 1) х}, 0sr«o 


= Coefficient x* ^ ^in А Ix +1) х" -2x(rDx** + (и 1) х" d? 
We now put k = 2, 3, ..., 12, and record the coefficient to get 

Pa = А, Р» = 2А, P4 = SN, Ps = 4, Pe = SN рз = б), Pg = 5А 
We can use p, = р», = рд g tO recover 


Pg = Bo Po = Ps Pio = Pa Р. = Р» Pi = Рэ. 
All these results can be condensed into a single formula 


6-17-kl k-1 
Рие РЕ РЕД? ог p, = Pi4-k e % Л. 


Case of Three Cubical Dice : 
p, = Coefficient of x* in (x + TAN Z" OMON 3<k< 18 
23: Coeffidientof 3^7? im(1 + x xy, [A = 1/216] 
Dn Posttcient ore 7^ in ftt Sx 3) 9 0-35 a -3y? 
77. "Coefficient x ^in [1 3x5 + 3x" — x) [X ((r + 1) (r + 252] x}, O< r $ о 
КОО л x^ "In(x ox 235 4D 75 ЗУ рУ ф(х!) 
where (r) =(r + 1) (r + 2)/2. Note that 
$(0) 21, (1) = 3, (2) = 6, 6) = 10, ф(4) = 15, ... 
We now put k = 3, 4, ..., 10, ... and obtain 
p, = A, p, = ЗА, р; = 6A, р = 10A, p, = 15A, pg = 21A, py = 25A, Pio = 27А 
Other values can also be obtained from complement rule. 
Pe Рур кеге 
Thus, P3= Pip Ра = Pir Ps = Pie Po = Piss Рз = Pia PR = Pix Po = Pix» Pio = Pu 
These results can be condensed to 


= (К П) 


21(k 4) - (К° -1) 
А КОМ а E а 14. 
Pk 2 x 216 


‚3<К<8; p= 216 


Illustrations. (i) For three dice : 
Po? Pio =27 № : 25 À m 27 : 25 [Galileo Problem] 
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(ii) P(Sum more than 14] 1 
р =P\s + Pig + Рут + Рв [Apply Complement Rule] 
= pe p, + p, + ру = 20%, = 20/216 = 5/54. 


(iii) A and B throw 3 dice. If A throws 8, what is B's chance of throwing NM. number ' 
p = P{sum > 8} = 1 — P{Sum < 8} = 1 = {рь + ра + Ps + Po + Рт + Ps 
| — (А + ЗА + 6A + 100 + 15А + 21А) = 1 – 56А 


{жегш 
216 274 л АЧ 
Example 1. Find the chance of throwing more than 14 with three symmetrical dice. 
Solution. Here f = 6, n = 3, $ > 14; let P(Sum = S) = Ps, then 
P. = Coefficient of х“ in (x + Y aos: xy K6y 

= Coefficient of x' ^? in (l+x+..4 x)/216 

216 P, = Coefficient of x* ? in (1— x5 (1. 3? 


) 


= Coefficient of x*~* in (1 — 3x° 3x2 х!8) (1+ 3x 4. + 1 (r1) (r2) х +...) 


For the present situation, we require Coefficient of x^ XE xt. ye fors = 15, 16, 17, 18]. 
Coefficient of x? = 91 = 84 + 3 = 10, Coefficient of x^ = 105 — 108 + 9 = 6 
Coefficient of x'* = 120 — 135 + 18 = 3, Coefficient of x? = 136 — 165 + 30 = | 
P(S > 14) = р; + Pig + ру + Pig = (10 + 6 +3 + 19/216 = 5/54. 
Example 2. Compare the probability of a total of 9 with a total of 10 when three fair 
dice are rolled once. 
Solution. Here п =3,f= 6, S, = 9, 5, = 10. Now 
Po = P(S = 9) = Coefficient of x^ in (x + x° +... + x°)'/(6) 
= Coefficient of x? in (1 — x9? (1 — x)?/216. 


7. 216p = Coefficient of x° in (1 - 335 +...) [Le 3e e Dr D (26 +... ] =28—3 = 25, 
P(S = 9) = 25/216 


Pio = P(S = 10) = Coefficient of x? in (1—39? (1 — Ne et 
216p,, = Coefficient of x’ іп (15335 +...) [1 + 3x 4... + (DG 0 (n 2) x +... 
-36-9-27. 


Thus P(S = 10) = 27/216. It follows that P(S = 9) : P(S = 10) = 25: 27. 
Exercise 1(е) 


1. Complement Rule. Show that the probability of throwing a total of S with n Ordinary six 
sided dice is the same as the probability of throwing a total of (7n — S), 

2. Prove that the chances of throwing 10 in one throw with (a) 3 dice, (b) 4 dice are 1/8 and 5/81. 

3. Three fair dice are thrown once. If no two show the same face, prove that P (sum of faces = 7) 
= 1/36; P {one is an ace}. 

4. Counters marked 1, 2, 3 are placed in a bag, and one is drawn and replaced. T 


repeated thrice. Show that the chance of obtaining a [ога] of 6 is 7/27 he process is 
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5. Four tickets marked 00, 10, 01, 11 respectively are placed in a bag. A ticket is drawn at random 5 
times, being replaced each time. Prove that the chance of obtaining a total of 23 is 25/256. 


6. Out of 10 tickets, 5 are blank and the rest are marked |, 2, 3, 4, 5. Show that the chances of 


drawing a total of 10 in three trials when (a) tickets are replaced after every trial, (b) tickets 
are not replaced are (i) 33/1000, (ii) 1/60. 
7. Nine cards are drawn from a set of cards. Each is marked with one of the numbers 1,0, —1 and 


it is equally likely that any of the three numbers will be drawn. Prove that the chance of 
obtaining a total zero is 3139/(3)’, 


1-71. Probability and Number-arithmetic 
Example 1. Chebyshev's Problem. What is the chance that two numbers, chosen at 
random, will be prime to each other ? 
Solution. When an arbitrary number n is divided by any prime number p, the remainders 
аге 0, 1, 2, ... p — 1. So if A is the event that л is divisible by p, P(A) = (1/p) since only one 
case, viz. zero is favourable to A. Consequently, if two numbers x and y are both 
divisible by p, then 

P(AB) = P(A) P(B) = (1/p) (1/р) = (V/pY. 
It follows that, both x and y are not divisible by p has the probability 1 — (1/р?). So, for 
every two relatively prime numbers, the required probability is 


3 1 6 
Р = [I кра [From Trigonometry] 


p=0 

Example 2. A five-figure number is formed by the digits 0, 1, 2, 3, 4 (without 
repetitions). Find the chance that the number formed is divisible by 4. 
Solution. We can arrange 5 digits in 5! ways, but if the numbers start with 0, the 
effective arrangements reduce to N = 5 ! - 4! = 96, because there are 4 ! arrangements 
corresponding to the numbers 0 abcd. 
Now the numbers ending in 04, 12, 20, 24, 32, 40 are obviously divisible by 4. 
Consequently, we find arrangements with these endings : In 

xyz 04 : x, у, z can be arranged in 3 ! ways; xyz 40 and xyz 20 : x, у, z each can be 

arranged in 3! ways 
хуг 12 : x, у, z can be arranged in 3 ! – 2! = 4 ways. [x = 0, extreme-left, reduces 
the cases] 

xyz 24 : x, y, z can be arranged in 3! — 2! = 4 ways. 

хуг 32 : x, у, z can be arranged in 3! — 2! = 4 ways. 

xyz 40 : x, y, z can be arranged in 3! ways. 
Total number of favourable cases, by Rule of Sum, is 30. Hence p = 30/96 = 5/16. 
Example 3. Digits 1, 2, 3, 4, 5, 6, 7 are written down in any order, [each possible 
order being equally likely] to form a seven-digit number. Find the chance that this 
number is divisible by eight. 
Solution. The total number of equally likely seven-digit numbers is N = 7 ! = 5040. 


We find the number of favourable cases M included in N which are divisible by eight. 
Note that 1,000 and hence 10,000, 100,000 and 1,000,000 are all exactly divisible by 
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eight, and that 100, 10, 1 leave respective remainders 4, 2, | | 
itm that when the seven-digit Sania abcdefg is divided by 8 there will be a 
remainder of the form R = 4e + 2f + g. Thus we need calculate the different possible 
values of e, f, g which make R an exact multiple of 8. Triplet (x, y, 2) means g = x, 
f=y, e = z. The sets of value rendering R an exact multiple of 8 аге: 

(2, 1, 3), (2, 1, 5), (2, 1, 7), (2, 3, 4), (2, 3, 6), (2, 5, 1), (2, 5, 3), (2, 5, 7), (2, 7, 4), 
(2, 7, 6); (4, 2, 6), (4, 6, 2); (6, 1, 2), (6, 1, 4), (6, 3, 1), (6, 3, 5), (6, 3, 7), (6, 5, 2), 
(б, 5, 4), (6, 7, 1), (6, 7, 3), (6, 7, 5). 

These are 22 triplets indicating 22 different favourable sets of values of e, f, g. For 
each triplet, there are 4 ! different orders of the remaining four digits а, b, c, d. Thus 
M = 22 x 4 ! (favourable seven-digit numbers). Consequently 


EUM I. 


Ere. ын, Pind Mis. 


1 on division by 8. It 


Exercise 1(f) 


1. Show that the probability that a positive integer selected at random is relatively prime to 6 is 
1/3. And that at least one of two integers selected at random is relatively prime to 6 is 5/9. 

2. (a) Find the probability Py that a natural number chosen at random from the set ( 1, 2, 3, ..., N} is 
divisible by a fixed natural number k. Also find lim Р,, as N — о. 

(b) Find the chance that an integer chosen from the first 100 natural numbers is divisible by 
at least 2 of the four primes : 2, 3, 5, 7. 

3. If 4 whole numbers taken at random are multiplied together, show that the chance that the 
last digit in the product is 1, 3, 7 or 9 is 16/625. 

4. Four positive integers are chosen at random. Prove that the chance of their having a common 
factor is ] — (90/n*). 

5. Anumber consists of 7 digits whose sum is 59. Prove that the chance of its being divisible by 
11 is 4/21. | 

6. One card is selected at random from 100 cards numbered 00, 01, ..., 98, 99. Suppose X and Y are 
the sum and product respectively of the digits on the selected card. Find P(X-klYz20). 
[pz 1/19, Kk 20; p 22/19; k «1, 2, ..., 9]. 

7. The numbers 2, 4, 6, 7, 8, 11, 12, 13 and 17 are written respectively, on 10 indistinguishable 
cards. Two cards are selected at random from ten. Show that the probability, that the fraction 
formed with them is reducible, is 4/61. 

8. Ifa3-digit number (000 to 999) is chosen at random, find the chance that exactly | digit will 
be greater than K. 

9. Show that the chance that the last two digits of the cube of a 4-digit random integer will be 
two ones is 0.01. [We assume that any four-digit integer has the same chance to be chosen]. 

10. Out of 6n tickets numbered 0, 1,2, ..., бл — 1, three are drawn at random. Show that the chance 
that their sum is бл, is given by 3n/(6n — 1) (6n — 2). 

11. An integer expressed in the decimal system requires five digits. Stating reasonable assumptions, 
find the chance of guessing the number. 

12. Let $(n) denote the number of positive integers which are less than л and which are primes 
relative to n. Prove that (n) = n [[(1 — p^!) where product extends over all prime divisors p 
of n. [6(n) is Euler's function]. 
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1-80. Miscellaneous Worked-out Problems 
Example 1. Show by examples that Р(ВІА) + P(BIA) 
(i) may be equal to 1, 

(ii) may not be equal to 1. 

However Р(А1 В) + Р(А | В) = 1 is true. 
Solution. We assign probabilities as under 


(i) P(AB) = Р(АВ) = P(AB) = P(AB) = 1 


P(AB) , P( AB) 


| 1 
Тһеп р = Р(ВІА) + Р(ВІА) = 222 зы tty fa) 
m" — — E 
(ii) P(AB) = P(AB) = P(AB) ==. P(AB)- 
pensa ea AB) Иә, 12. 241 


PATS PA)... 21 (ЖУК 6 


P(AB) , Р(АВ) _ P(AB) + Р(АВ) _ P(B) _ 
ру PCB) P(B) P(B) 
Example 2. A die is thrown as long as necessary for a 6 to turn up. Given that the 6 does 
not turn up at the first throw, find the chance that the more than four throw will be necessary. 
Solution. That more than four.throws are needed means that in the first 4 throws there 
is no 6 occurring. Let N, denote the event that 6 does not occur on throw i, (i = 1, 2, 3, ...) 
Trivially, P(N,) = 1. The desired probability is thus 
РМ -N,+N,-N,1N,} = РОМ) P(N, VN) PCN, ІМ №) РОМ, ІМ, < N,- М.) 
= (3/6). (5/6) - (5/6).2.125/216. 

Note that N = N, - №, - №, - N, and М, are not independent, for P(N | N,) = P(N). 
Example 3. Out of n products, each with a distinct coupon, one has collected a set of 
r coupons, each of which is independently a type j coupon (labelled С) with probability 
РЬ where р, + p, +... + p, = 1. Find the probability that this set S contains coupon C, 
given that 5 "Hes coupon С, (j # k). 
Solution. Write C; = (Set $ на coupon С;). Then we need 

P(C,I C] = РСС РЕС). (1) 


Now P{C,} =1 - P{C,}=1—P (n, C, coupon in S} 


(iii) P(AIB) + Р(А1В) = 


= 1-(9,) [p, * q, = 1] 
|- РІС, UC,} [P(A)= 1 - P(A)] 
1 - (P(C;) + P(C,) - P(C,C,)) 


P(CC,) 
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As РІС, C,) -1- (gj +9 - [1 - p, - al 
Substituting into (1) yields 


PIC, IC;)2 (1- qj - Ф +(1- р; = py)" 101-41: 
" ili f € t | t 
Example 4. A coin is tossed (m + п) times, m > n. Show that the probability of at leas 
m consecutive heads is (n + 2)/2" * !. | OU" 
Solution. Let H and T denote the occurrence of head and tail respectively. Let enote 
the occurrence of head or tail so that 


P(H) = 1 = Р(Т); P(Y) = P(H Ө T) = P(A) + P(T) = 1. 
LetZ, 2 HO HY... П Ил of m consecutive heads), У, denoting head or tail 
on the jth throw. The possible sequences of interest are 
S2 FR. EY Sou TZ YYY.. X Sum FIZ Yr 


m m 


SAEPE ЛИИ 1) terms before 2, ],5 , , 2 Y ... У. TZ,, (n terms before Z,,) 
P(S, )= PZ,). СРСР)" s (1/2)" 
P(S,) = P(T) . P(Z,) [P(Y)]" = (1/2) (10/2)" . (1) = (1/2)" * ! 


ni 


P(S) 24PQ]". РСТ) . P(Z,). (РСР ^ 939002) . 0/2)" . 1 = (1/2)" +. 


nm 


PCS, i D [QD]! . PCT) . P(Z,,) = 1. 0/2) (2)" = (1/2)" * ! 


p = P{S, tt Sa tt d tt Be, " РА (1/2)" 4 n(1/2)" * 1 a (n + 22)” t A 
Example 5. Match-Mismatch Problem. ‘n’ different objects 1, 2, ..., n are thrown at 
random іп л places marked 1, 2, 3, ..., n. Find the probability that n none of the objects 
occupies the place corresponding to he number. Also find P{Exactly r objects occupy 
their matching places}. 


Solution. Write M; = {object i falls in slot i}. That is M; denotes the match occuring at 
slot 7. Then probability of at least one match P{L,} is 


P{M,UM,U.. UM be M) УР(М, М) + У Р(М, M, M,)-... 


i<j i«j«r 


*(-1/7! ZZ..ZP(M, M, -M;)+...+(-1)""'P(M, M, ... M.) EXD 


n 


ED 
Now P{M} = 1.907 [one favourable slot out of п] 
Tiada » (4291 
P(M,Mj) = PUMA P(M,IM,} = у =—— 
P(M,M,M,) =P{M,} P{M 1M) P{M.iMmj=1 1 (пЭ)! 
Id * t NS mM n n-l1'n-2 n! 
(n - 7)! 

In general: — P(M,. M,,,.., M; }= NM ' rui... c2) 


Substituting into the Union Rule (1) and using symmetry of evaluations gives 


(n — 1)! -(7) =” 2)! Y Ay. (n — 2 "S (n — n)! 
һи) = (2 Араа утэ SM uso (-1) (p) ez 


n! 
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i n n! TM" T" 
Using (5 = =, кее? this simplifies to 


= 2 | 1 (-1)* 1 E i 2. n ер)" l 
PL) = 1-545 а Poa „у СО. 


The probability of no matches is given by 


P{M, M,...M,} = I- P(L]-1- Y — = Y Lv ...(3) 
EU CK! fg UA 


Second Part. Probability of exactly r matches = PCE). 


We consider all possible arrangements of r successes in n trials, viz. P and hence 


P(E) =(")P{M, M, ..M, M,,,M,....M,} 
EE Seo IM eM] 
= (^) PS) Por lS. [By Product Rule] NC 
Now P) = © [by Eq. QJ] 
P(F, ,1$,) = P(AII (n — r) objects mis-match} = by nS. [by (3)] 


Substituting these evaluations into (4) yeilds 
n! (n—r)! &x (Dt 
О а Oe, | fe Kl 


P(E) = 


109) 


Example 6. Each coefficient in the equation ax. + bx + c = 0, is determined by throwing an 
ordinary die. Find the probability that the equation will have (i) real roots, (ii) complex roots. 
Solution. Coefficient a, b, c are each uniformly distributed over {1, 2, 3, 4, 5, 6}; hence 
the exhaustive number of cases N = 6 x 6 x 6 = 216. [The three coefficients a, b, c are 
realy determined by throwing a die three times]. The roots of the given equation are 
real iff 4ac < b°. Since max b = 6, min b = 2 (to satisfy the constraint), the favourable 
Cases are as under : 


Ls [essa TD 


(1,1) 
(1, 2), (2, 1), (1, 2) 
(1, D), .... (1, 4), (2, 1), (2, 2), (3, 1), (4, 1) 


(1, 1), .... (L, 6), (2, 1), (2, 2), (2, 3); (3, 1), (3, 2), (4, 1), (5, 1), (6, 1) 
(1, 1), -~ (1,6); (2, 1),... 2,4); (3,1), 3,2), 3,3), (4, 1), (4,2), (5, 1), (6, 1) 
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net < 3 : 

Thus total No. of favourable cases = 1 + 3 + 8 + 14 + 17 = 43. So p = 43/216. 
The probability that the roots are complex is q = 1 - р = 173/216. 


Problems with Solutions Provided at the End of the Text 


1*. ША (ПВ = , show that P(A) < P(B) and P(B) < РСА). 

2*. Ап urn contains п white balls numbered 1 through л, n black balls numbered 1 through 
n and n red balls numbered to 1 to n. Two balls are drawn at random without replacement. 
Find the chance that both balls are of the same colour or bear the same number. 

3*. The Mathematician, Professor S.S. Khurana, travels from Iowa City to New Delhi 
with stop-overs in New York and London. At each stop his luggage is transferred 
from one plane to another. In each airport, including Iowa, chances are that with 
probability q his luggage is not placed in the right plane. Prof. Khurana finds 
that his luggage has not reached Delhi. Find the probabilities that the misplacement 
took place in Iowa, in the New York and in London, respectively. 


1-90. Comments on ‘Surprise’ and ‘Uncertainty’ 


Naively, the surprise one feels upon learning that an event A has happened depends 
on P(A) = p (say), 0 « p € 1 and thus we denote the Surprise function by S(p). Obviously, 
S(p) = 0 if p = 1 (certainty) and our surprise decreases if p increases. Further, span of 
p maintains span of S(p) and occurrences of additional events adds to additional surprises. 
These facts lead to the definition. 


S(p) « —0n, p (a> 1) [Structure of S(p)] 
The Uncertainty or Entropy, denoted by H is defined by 
Н -E[S(p)] = E(- (п, p). ' 
Thus, for the probability ensemble (X, p) ; X = xj, .., x, and p = Py «p, wedefine 
H(X) = E[S(p)] = - Ep; Un, p; 


Illustration. Urn A contains 60 red and 40 blue balls and urn B contains 6 red and 4 
blue balls. An urn is chosen at random and 2 balls withdrawn simultaneously. 


(i) You win a prize if either ball is red. 

(ii) You win a prize if either ball in blue. 

Which urn, A or B, gives you the best chances of winning the prize in case (i) ? in case (ii) ? 
Solution. We evaluate entropies H, and H, for both cases 


100) _ 177 
(i) P{2 red balls}, = ear ? J- 7036 


| 
P(2 red balls), = H / ш “033 


H, = -p Un, p =—(0.36) фп, (0.36) = 0.53062 
H, = -p în, p = —(0.33) (п, (0.33) = 0.52762 
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H,>H, => urn B is of greater certainty for red balls. 


(ii) P{2 blue balls}, = PMES = dog =076 


P{2 blue balls}, = Bb 2 = 0.13 


Н, = (0.76) dn, 10.76 = 0.42302 
Hg = —(0.13) dn, (0.13) = 0.38264 
H, > Н, > urn В is of greater certainty for blue balls. 
Conclusion. In either case, (i) or (ii), urn B yields the best chances of winning the prize. 


Miscellaneous Exercises 


1. With usual notation, show that 
(a) If P(A) = P(B) = 1, then P(AB) = 1. 
(b) If (A) = 1, i= 1, 2,..., then P(f]; A) = 1. 
(c) If P(AI! C) > P(B 1I C) and P(A IC) 2 P(BIC) , then P(A) 2 P(B). 
(d) Prove: P(A | B) = P(A | BC) Р(СІВ) + P(AIBC)(CIB). 
(e) Under what conditions does the following equality hold : 


P(A) = P(A|B)+ P(AIB). [A2 OQ, В= ©; B-A, В= A, B- ©] 


2. (a) The probability that a student passes Mathematics is 2/3, that of passing Biology is 4/9. 
If the probability of passing at least one course is 4/5, show that the probability that he will 
pass both courses is 14/45. 

(b) Eight persons are arranged in a row, all possible arrangements being equiprobable. Find 
the chance that two persons will be next to each other. What happens if arrangement be in a ring ? 

3. The chance of first event happening is the square of the chance of a second event, but the 
odds against the first are the cube of the odds against the second. Find the chance of each. 

[Ans. 1/9, 1/3] 


4. Two unbiased dice, one green and other red, are tossed simultaneously. Let g and r denote the 
numbers on green and red die respectively. Find 


(a) P{g2r+4} (b) P{g#r} (c) P{g=r} 
(d) P(g- r^), (e) P(g*rz7), (бй P{g+r=10} 
(gp P{g=3r} (h) P{g -r= 1}. [Ans. 3p, 30р, 6p, 2р, 30р, 3p, 2p, Sp, p = 1/36] 


5. А box contains 20 fuses of which 5 are defective. Show that the probability that the two fuses 
are defective when they are selected at random and removed from this box, without replacing 
the first is 1/19. 

6. Four persons are chosen at random from a group of 4 men, 3 women and 5 children. Prove that 
the probability that exactly two of them will be children is 16/27. 

7. You need 5 eggs to make omelet for break-fast. You find 12 eggs in the refrigerator but do not 
realize that 3 of them are rotten. Show that the probability that of the five eggs you choose 
(a) exactly one is rotten, p = 21/44, (b) none is rotten, p = 7/44. 
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(a) A die is rolled 3 times. Prove that the probability that you get a larger number each tin 


is 20/216. 

(b) A pair of dice is tossed a 
on first throw, find the chance that more than two thr à 7T 
(c) Two tetrahedra are tossed repeatedly until a total of 5 appears on the down faces that 


P (More than two tosses are required} = 9/16. 
A king is placed at random on any square of a standard chess-board, other than ie edze- 
squares. A queen is placed at random on any square of the same chess-board other than the 
square occupied by the king. Prove that the probability that the king and the queen are on 
neighbouring (horizontal, vertical or diagonal) squares is 8/63. 

A bridge player knows that his two opponets have exactly five hearts between the two of 
them. Each opponent has 13 cards. Prove that the probability that there is a three-two split on 


> ; 5) (21) 26 
the hearts is LI 


From 25 tickets marked with the first 25 numerals, one is drawn at random. Find the chance 

that it is a multiple of : (a) 6, (b) 3 or 7, (c) 5 or 7, (d) 3and 6. [Ans. 0.16, 0.40, 0.32, 0.32] 

Three distinct integers are chosen at random from the first 20 positive integers. Show that : 

(a) P {their sum is even} = 1/2, (b) P (their product is even} = 17/91. 

(a) Four people are dealt five cards each. The first player gets four hearts and one club. He 

discards the club, and takes in exchange the top card from the remaining 32 cards. Show that 

the chance that he now has 5 hearts is 9/47. 

(b) A trainee gunman fires л shells at a target. The chance of the kth shell hitting the target is Pe 

| <k € n. Find the chance that at least two shells will hit the target. 

A bowl contains 16 balls of which 6 are red, 7 are white and 3 are blue. If 4 balls are taken at 

random and without replacement, show that : 

(a) P{Each of the four balls is red} = 15/1820 

(b) P(None of the balls is red} = 210/1820 

(c) P{ There is at least one ball of each colour} = 819/1820. 

An urn contains five red and three white balls. The red balls are numbered О, 1, 2. 3. 4 

respectively and the white balls are numbered 0, 1, 2 respectively. Two balls are withdrawn 

without replacement. Prove that the chance that these balls have either the same number or 

the same colour is 4/7. 

Each of the n urns contains three chips numbered 1, 2, 3. A chip is chosen at random from 

each urn yielding a set S of integers. Prove that the probability that this set contains each of 

the numbers 1, 2, 3 at least once is 1 ~ 3(2/3)" + 3(1/3)". 

(a) Fifty-two persons stand in a line, each to draw without replacement, a card from an 

ordinary deck. The Queen of Spades is the prize card. What place in the line is the best ? 
[Ans. All positions in the line are equally likely] 

(b) If n people are seated around a round table, what is the chance that two named individuals 

will be next to each other ? [А п. 2/(n – 1)] 

In a T maze, a rat is given a choice of going to the left (L) and getting food or going to the 

right (R) and getting some shock. Before any conditioning (in trial No. 1) the rats are equally 

likely to go to L or to R. After getting food on a particular trial, the probability of going to 

L and to R become p, » 1/2 and q, on the following trial; but in case of a shock, these 


> 


20. 


21. 


22. 


26. 


27. 
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probabilities are р, and q,. Find the probability that rat will turn to L on trial number 2 and 
also on trial number 3. (p, > р). Also find P{rat turns to L on trial 3 | rat turned to L on trial 1) 
A bag contains 6 white and 9 black balls and four balls are drawn at a time. Show that the 


probability p for the first draw to give 4 white balls and the second to give 4 black balls when 
(a) The balls are replaced before the 2nd draw p = 6/5915. 

(b) The balls are not replaced before the 2nd draw p = 3/715. 

An elevator starts with 7 passengers and stops at 10 floors. Show that 

(a) Р{ № two passengers leave at the same floor} = 109 ... 54/( 10)’ 

(b) P(AII the passengers are discharged on the Sth floor} = (10)7 

(c) Р{АП of the passengers are discharged on the same unspecified floor} = (10)° 


(d) P(Exactly, three of them are discharged on the 2nd floor} = (3) (7)" / (10)? ]. 


A bag contains 10 balls either black or white, but itis not known how many of each. A ball is 
drawn at random and it is found to be white. Assuming that all combinations of white and 
black balls are equally likely, show that the chance that the bag contains at least 5 white balls 
originally is 0.82. 


A consignment of 15 record players contains 4 defectives. The record-players are selected at 
random, one by one, and examined. The ones examined are not put back. Prove that the 
probability that the 9th one examined is the last defective is 8/195. 


An urn contains 5 balls. Two balls are drawn and found to be white. What is the probability 
of all the balls being white ? 


From a basket containing 3 bad and 7 good oranges, two are selected at random. If the second 
selected is given to be bad, show that the chance, that the first selected is bad is 2/9. 


Two ordinary six-sided dice are tossed. What is the probability that both the dice show (a) the 
number 4, (b) the same number. Given that the sum of the two numbers shown is 8, find the 
conditional probability that the number noted on the first die is as large as the number noted on 
the second die. [Ans. 1/36, 6/36, 1/5] 


The probability that a person stopping at a Petrol Pump will ask to have its tyres checked is 
0.12, the probability that he will ask to have its oil checked is 0.29 and the probability that 
he will ask to have them both checked is 0.07. 


(a) What is the probability that a person stopping at this Petrol pump will have : 
(i) Either his tyres or his oil checked ? 
(ii) Either his tyres or his oil checked but not both ? 


(b) What is the probability that a person who has his tyres (oil) checked will also have his oil 
(tyres) checked ? [Ans. (a) 0.34, 0.41; (b) 7/29, 7/12] 


A hand of 13 cards is to be dealt at random and without replacement from an ordinary pack of 
playing cards. Find the conditional probability that there are at least 3 kings in the hand 
given that the hand contains at least 2 kings. 


ГЕТЕА АТУ ТОИ 
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Elementary Probability : Basic Concepts 


2. 3. 4 are distributed at random on four pl 
s occupies the place corresponding to its 


Four different objects 1, aces marked 1, 2, 3, 4. 
Prove that the probability that none of the object 


number is 3/8. 


One term of the expansion of a determinant 0 
the probability P, that it does not contain ele 


f the nth order is chosen at random. Show that 
ment of the principal diagonal is 


| im Р = e 


by 1 1 1 nA 
Ps | dms те "T n-o 


n 


[Hint. The number of the terms in the expansion of a Det. of nth order equals n! (in general. The 
number of terms containing one given element [or two given elements] is (n — 1)! [or (л — 2)! etc.] 

ou can toss a biased coin with head probability p upto 7 times. You win Rs 1000.00 if three tails 
appear before a head. What are your chances of winning ? 


Reason has always existed, but not always in a reasonable form. (Karl Marx) 


sjsieseseseseneieieteieieiedeleleieieieieokieieneneietetenenen iiie 


It is a mistake to confound strangeness with mystery. 


(Sherlock Holmes : A Stud 


Probabilistic Independence. 
Baye’s Reversal Rule 


We consider some special rules to evaluate probabilities of compound events. We 
commence with the most frequently used Basic Rule : 


2-10. Multi-Stage p-Rule or Theorem of Total Probability 


If A,, A,, ..., A, is a partition of the sample space Q and B is some proper but arbitrary 
event caused by A; then 


P(B) = P(A,) P(B | A.) + P(A,) Р(ВТА,) +... + P(A.) P(B1À,). 


(it) 
Proof. The events А, А,, ..., A, form a partition of Q, hence they are disjoint and 
accordingly the events A,B, A,B, ..., A,B are also disjoint [See Fig. (1)] and so by point- 
set algebra | 

B AGUAS U A,B. 

Taking probabilities of both sides and using [P3'] (finite additivity) we get 
P(B) = Р(А В) + Р(А,В) +... + Р(А В) = P(A,) P(B | A,) + Р(А,) P(BIA,) +... + P(A,) P(BIA,), 
the latter being the consequence of the Product 
Rule : P(CD) = P(C) P(D | C). 
Special Case. Suppose A (# €2) and B are events 
such that B c A and A = A, CU A, ©... DAW Then 


P(A,) 


P(A.) 


P(B) = YP(A) P(BIA,), i212, n. 
i=] 


Proof. Неге О = А, U A,U .. 0A, U A, BN A =Ø. P(A,) € 
Since, by point-set algebra. B = А,В О А,В 6 ... 0 Tree diagram for the 
A BU AB, finite additivity [P3] gives Multistage p-rule. 
P(B) = P(A,B) + Р(А,В) +... + Р(А В) + P(Ø), f- AB=@} 


= P(A,) P(BIA,) + P(A,) P(BIA,) +... + P(A,) P(B1A,). [с РСР) = P(C) Р(Р1\ С)| 


08 Probabilistic Independence. Baye’s Reversal Rule 
Cor. x P(BUA) = 1 + (n – 1) P(B), VETS 1. 

Proof. P(A.UB) = P(A.) + P(B) - P(A, П B), hence 

| Nis UE PIE =1+(n—-1)P(B). 


E P(A,UB) => P(A) + nP(B) - EP(AjB) = 1 + nP(B) - P(B) 


2-11. Multi-Stage Conditional p-Rule 
Let Aj, A,, ..., А, ... be a partition of the sample space О and P(C) » 0. Then for | 
P(B | C) = P(A | C) P(BIB,C) + P(A,| C) P(BIA,C) +... + P(A, | C) P(BIA,C). 


any event B. 


Proof. The partition of BC by (Aj gives 


P(BC) = Ў,Р(А, ВС) = Y, P(C) P(A,BIC) 
Ei nes | 


Using P(BC) = P(C) P(B | С) and cancelling P(C) 0 in the above result yields 


P(BIC) = È P(A,BIC)= X, P(A, 1C). P(BIA,C). 
ыл, 121 


2-12. Worked-out Problems 

Example 1. Craps Rule. Let A and B be m.e. events of an experiment. If indep. trials 

of this experiment are performed, show that A occurs before B with probability P(A)/ 

[P(A) + P(B)]. 

Solution. Write H = {A occurs before B does} and 
E = (event E occurred on the kth trial} 


G=(AUB), P(G)= P(AUB)-1- Р(А) – P(B): 
Here $-4A U BUG. Now by multistage p-Rule. 
P(H) = P(A) P (H V AU) + P(B) Р(Н VB) + P(G) P(H | С) f 
"P P(H | AU) = 1, P(H 1 B) = 0, P(H 1 GU = рүн). I» 
Note that, when neither A occurs nor В occurs on trial 1, the game starts afresh and 
Eq. 2 (iii) follows, a starting-over argument. Now substituting from (2) into (1) gives 
gives 
P(H) = Р(А).1+0+ (1- P(A) - P(B)] . P(A) 

Ó P(H) = P(A)/[P(A) + P(B)]. 
Example 2. A man, condemned to death, is given two similar jars, 100 green balls 
and 100 red balls. He can distribute the balls in the two jars as he wishes. Afterwards 
he is blind folded and asked to randomly choose one of the jars and then blindly ДЖ 


one ball from the chosen jar. If he draws a green ball, he is pardoned and if he draws 
a red ball, he is executed instantly. S 


| 


M 


[Щ{ 
н 
) e 7 
9 


= G-(AUB) 


=== 
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How this man should distribute the balls in the jars so that extraction iof a green ball 
has maximal probability ? 


Solution. Write J,, J, for two jars and G denote extraction of a green ball. Suppose he 
puts x green balls in J, and (200 — x) balls in J,. Then, blind foldedly, by multistage 
p-Rule. 


P(G) =P(J,) P(GIJ,) + PU P(G J;) 


" - T 100 — x 
d wish 2007 
Note that, derivative (dp/dx) does not help solve the problem. 
Now, p, = (300 - 2x)/2(200 - x) 
149 148 tar 
= — —— = {), 4 = 0.7462 
P, = 199 = 0.7487, p, = 198 0.7475, p, = 197 62 


The sequence (p,) indicates that p, decreases x increases. Hence, this man should put 
only one green ball in one jar and 199 balls in the other jar to maximize the chances of 
escaping death. 


Example 3. Gambler's ruin problem : Timed play (One-unit bet). Gambler A, who 
at each play of the game has chance p of winning one unit and chance q = | — p, of 
losing one unit. The successive plays of the game are assumed independent. Find the 
probability that, starting with i units, A's fortune will reach N, before reaching zero 
(ruinous stage). 
Solution. Let E, = (Starting with i units, A eventually reaches №} 

W, = (A wins the first game} 
Conditioned on first game the multistage p-Rule gives 


P(E) = PW) P(E/W) + P(W,) P(E; |W,) I) 


Now PW,) = p, PW,)=4, P(E; WW) = P(E;,,), PCE; IW)- P(E; ) 
Since winning increases assets to (i + 1) units and losing decreases assets to (i — 1) 
units and the games if continued, is as to begin with. We write 
P(E,) =P, and (i) yields | 
=a PBS) КЕРЕ =P, =P Pi. = ФР, 
We write P, =(p + q) P, and rewrite above as 
POP; те P) m PPP) UP, pU PRA, = Р, у), "iu 
where A = q/p = (lose/win) ratio. Since P, = 0 (no asset, no win), relation (1) gives 
P,- P, =(P,- Po) = AP, 
P, - P, 2A(P,-P)- Ар 
P,- P, = MP,- Р,) = x P, 
Pee Po. T T S TE Jen! ra 


i-1 
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60 Probabilistic In E. 
Adding the first (i — 1) equations give a 
P-P =(М+ +. +) | 

P. s((0-Xy(1 -3)) P, if A 1, іе. р + 4,16. P7 5 | 21.04 


2 i=] 
р> Р,=(1+%+ +... А )Р, 


=iP,,ifrA= lie. p=q= m 
Since | Py = 1 (Certainty), Eq. (2) using i = М, gives 
Pis (1- DLR) paupe NV 
Substituting this value of P, in Eq. (2) yield 


ДА-АА), ped. (eal p 
il N; if pez 
As N — c,  — 0 (if p> 1). Then 


ATE i 9 
NN (1-2), m pes (A = 4/р) 
i E yt sa oe 


Consequently, if p > 5, A's fortune increases indefinitely, but if p < +, A will go broke 
against an infinitely rich adversary. 


Comments. In the Theory of Markov Chain, this problem is diversified embracing a 
large class of problems. 


Example 4. Urn A contains a white and b black balls and urn B contains C white and 
о black balls. A certain number k(< а + b) of balls chosen at random is transferred 
from A to B. Find the probability of drawing a white ball from B after the transfer. 


Solution. Among the k balls chosen from A, let X be the number of white balls so that 
the possible values of X аге 0, І, 2, ..., К, write 


W = {White ball drawn from B after the transfer of k balls from A} 
Now, by Multi-stage p-Rule 


ph хр. Р(Х = х) = xz " p ae h »)) (ah 
cmt AOE MEI HE C75) 


| 
* (c+d+k) 


ка || ka 
ED m BP = OS НЕР) 
< Маъ твр (x /к-х; 
© [(at+b)(c+d+k)] 


Remark. Considering transfers of three balls of various combinations would require 
Four conditioning events. The above is certainly a shorter solution requiring only two 
conditioning events. 


P(W) 


{ex1+E(X)}, X~ HG (a + b, k, p) 
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Example 5. Each of the n urns contains a white balls and 5 black balls. One ball is 
transferred from the first urn into the second, then one ball from second into the third 
and so on. If P, is the probability of drawing a white ball from the kth urn, show that, 


а+1 
ee areal “sap aO 

Deduce that for the last urn, P, = a/(a + b). 
Solution. Let us denote kth urn by U,. A white ball from U, can be extracted in the 
following two disjoint ways : 
(i) A = (Ball transferred from U, _ , to U, is white}, P(A) = P, ,. 
(ii) B = (Ball transferred from U, _ ќо U, is black}, P(B) = 1 — P,- 1. 

W = {a white ball is extracted from U, after the transfer], — 


So P(W) = P(A) P(W | A) + P(B) P(W | B) [Multi-stage p-Rule] 
а+1 j 3 ; 
PUES E] +(1- Urea [with obvious evaluations] 
i.e. DEP, ae, c - 1/(1 * a + b) AE) 
P,=ac + cP,»,=ac + clac+cP,_,} 2 ac * ac^ + eRe 
= (ас + ac’) + c^ [ac +cP,_,)=ac+ ac *ac 4c piis 
Eccc ud +h. tae ср, | [P, = a/(a = b)] 


ac(l+c+t+ gee Oe С) DAFT S [a/(a = b)] 


© HAIR paci) bi in arf A, sure 
S EL a+b| l+at+b’ Са+Ь+1_ 


а k-1 k-1 a 
E {1 SE E ] = Dep 
Remark. The solution of difference equation P, = xP, |, + y, is given by 

Р. = (Ру А) х" 6 X yl - х). 
This provides result immediately from (1) : an excellent alternative solution. 
Example 6. From an urn containing a white balls and b black balls, a certain number 
of k balls is drawn, and they are laid aside, their colour unnoted. Then one more ball 
is drawn. Find the chance that it is a white or a black ball. 
Solution. Let X be the number of white balls among the К removed balls and Y be the 
number of white balls that remained in the urn so that X + Y = a. Let W = (ball drawn, 
after the removal of k balls, is white}. Then, by Multi-stage p-Rule. 


P(W) = EP(W1Y 2 0) P(Y=y) 


вй - Р 
m аЬ P(Y = у) c /k-x5 
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1 1 
————— — P(Y = E(Y) 
AT le ать) 
From X + Y = a, we get E(X + Y) = a > E(Y) =a - E(X). 

As X ~ HG (a + b, а; К) so that E(X) = kp =k. (a/(a + b)} 


_ ha. | a(a + b- k) "LP 
Ри) = {а а а+ь-0= VN Зра е t 


Example 7. The game called craps is played with two dice. The caster wins at once if 
the sum is 7 or 11 (called naturals). He loses at once if the sum is 2, 3 or 12 (called 
craps). But if he produces sums 4, 5, 6, 7, 8, 9 or 10 (called points) he has the right to 
cast the die repeatedly until he throws his point again and wins or loses by throwing a 
seven. Find the probability of caster’s winning. 

Solution. Let W, denote that the player wins on the first throw and G denote that the 
player wins on game points condition. If W denotes that the player wins, then 


P(W) =P(W, € G) = P(W,) + P(G) way 
For a pair of dice, sum k, we have 

P(S) = {6-17 – k |}/36 pss i ) 
Also  P{A wins before B} = P(AY[P(A) + P(B)] ... (11) 
Now РО) 2 PS; 0 5,1) = P(S,) + P(S;,) = эв +з == 02222 02) 


Player's game plants аге T = (4, 5, 6, 8, 9, 10} 
P(S,) = P(S,9) = 3/36, P(S.) = P(S,) = 4/36, P(S,) = P(S,) = 5/36. 
Further by (ii), 
P(G|S,) = Р{Сате won given S, occurs 5, k e T) 


Р у Bod иј 


РО SOS И [Using (1)] 
P(G) # ZPO POGWSO [by Multi-stage p-Rule] 
Pee ал АШ а T (6-17 - kl 
- | 36 TED 36> 12-17- ki 
ЛАЕК 
- z(1*$*5- 495 = 0270707, (3) 


Substituting from (2) and (3) into (1) yields 
P(W) 20.222222 + 0.270707 = 0.4293 = 0.493. 


Example 8. Persons A and B often forget their umbrellas in some way or ther 
A always carries his umbrella when he goes out while B does it 50% of "A е a ^ 
A and B forget their umbrellas at any shop with probability p. After vi „ай * 
shops, they return home. Find i Siting their 


(a) P{They both have umbrellas}, (b) P{They have only one umbrella}, 
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(c) P{B has lost his umbrella given that there is only one umbrella after their return). 
Solution. We designate the events as under : 


A = [A's umbrella intact}, А, = {A does not forget his umbrella in shop /}, Н = {В has 


left his umbrella at home} 


E, = {They have only one umbrella}. Terminology for B is similar. 


Р(АВ) = P(A А,А) П P(HB,B,B,) © (A,A,A,)H}, [At home after shopping] 


= P(A A243) P(H) P(B,B,B,) + P(A,A,A,) P(A) = q(iq 4 qi) -lq'-4q) 


P(A) = P(A forgets his umbrella) = P(A б AA, ici A,A,A3) = р+ар+4р= р(1+9 + 4) 


P(B) = P(B forgets his umbrella} = P(HB, U HB,B, © HB,B,B,) 


= $p*iqp*iq p-lpü«qeq)) 


P(A) = 1- P(A) »1- р(1+9+42) = 4 


P(B) = I- P(B)=1-1p(l+q+q’)=401+q°) 


(Only one umbrella) = AB 9 AB 


P(AB У AB)= P(A) Р(В) + P(A) P(B) 


1р(1+9+9?).4 +4(1+q°) pl+q+q°) 


sho piling + q^) (44295) [Probability of only one umbrella] 


(c) P{ABI(AB € AB) = P{AB}/P(AB t AB) 


j^. 


3". 


4*, 


= 1p eq q).q [1 p(3 +4?) (1 24?) 


= qa 247) 

Problems with Solutions Provided at the End of the Text 
Between-ness property. For any event B, the value of P(A) lies between those 
of P(A | B) and Р(А1В). 

Two cards are drawn at random sucessively without replacement from a full 
pack of 52 playing cards. Find the probability that the second card may cover 
the first card. [That is, the 2nd card must be a superior card of the same suit]. 
Find the probability that the ace of spades (А) is next to the king of spades (К) 
in a well-shuffled pack of 52 cards. 


In a group of equal no. of men and women, 10% men and 45% women are 
unemployed. What is the prob. that a person selected at random is employed ? 


6*. 


T", 


5". 


Nt. 


10°. 


ШЕ", 
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An urn contains 6 tickets numbered 1, 2, 3, 4 5, 6. Another urn contains 5 


tickets numbered 2, 4, 6, 8, 10. One urn is chosen at random and a ticket і; 
drawn from it. Find the probability that the ticket drawn bears the number : 

(a) 3 or 6, (b) 4 or 6, (c) 1 or 10, (d) 5, (e) 10. 
An urn contains 3 red and 6 black balls, and a ball is chosen at random and set 
aside without noting its colour. If a second ball is now withdrawn, what is the 
probability that it is red ? How is the probability changed, if we know the colour 
of the first ball ? 

A box contains 4 balls numbered 0 through 3. One ball is chosen at random and 
kept aside. All balls with non-zero numbers less than that of the kept-aside ball 
are also removed from the box. Now a 2nd ball is chosen at random from those 
remianing in the box. Find the probability that the 2nd ball chosen is numbered 3. 
An urn contains N balls, among them just W are white. A random sample of size n is drawn 
without replacement and from this sample another random sample of size m is drawn 
without replacement. Find the chance that the second sample contains just k white balls. 
If the probability that a family has exactly n children is (1/2) 5910 2. 3,.... and 
if all 2" permutations of the sexes of the n children are eqully likely, find the 
probability that a family will have no boys. 

(Laplace Rule of Succession) of n biased coins, with probability (k/n) of falling 
heads for the kth coin, a coin is chosen at random and tossed (a + b) times. What 
is the probability that the last b tosses of the coin result in heads, when the first 
a tosses have already resulted in heads ? 

Let the probability P, that a family has n children be ap", and Р, = 1 ор (1 4 p & p. 
+...) п = 1. Suppose that all sex distributions of n children have the same distribution. 
(a) Show that for k > 1, the probability that a family contains exactly k boys is 
2ap i2. py’ 

(b) Given that a family includes at least one boy, show that the probability that 
there are two or more boys is p/(2 — p). 


Exercise 2(a) 


Comment on the statement (Simpson’s paradox) : It is possible to have P(A | B) < P(A | B), 
even though P(A | BC) > P(A! BC); Р(АІВС) > P(AIRC). 

In a group of employed persons 28% are women. 65% of the men and 40% of the women pay 
income tax. Show that the probability, that a randomly chosen person is a non-income-tax 
payer is 0.42. 

A bag contains 3 white and 2 black balls, and another contains 5 white and 3 black balls. If a bag 
is chosen at random and a ball is drawn from it, show that the probability that it is white is 49/80. 
Two-thirds of the students in a class are boys and the rest are girls. It is known that the 
probability of a girl getting a first class is 0.25 and that of a boy getting first class is 0.28. 
Prove that the probability that a student chosen at random will get first class marks in the 
subject is 0.27. 

Next year, there will be three candidates Mr. A, Mr. B, Mr. C for the position of a principal, whose 
respective chances of getting appointment are in proportion 4 : 2 : 3. The probabilities that these 


10. 


11. 


12. 


13. 


14. 


15. 


16. 


H. 
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persons, if selected, will introduce co-education in the college. are respectively 0.3, 0.5, 0.8 
Show that the probability that there will be co-education in the college next year is 23/45. 


A fair coin is flipped. If a head appears, then a symmetrical tetrahedral die (with faces marked 
1, 2, 3, 4) is rolled. If a tail appears, then an ordinary cubic die is rolled. Show that probability 
that the number of points on the die will be more than two is 7/12. | 
There are five guns that, when properly aimed and fired, have respective probabilities о! 
hitting the target as follows : 0.5, 0.6, 0.7, 0.8 and 0.9. One of the guns is chosen at random, 
aimed and fired. Prove that the probability that the target is hit is 7/10. 

A certain drug manufactured by a company is tested chemically for its toxic nature. Event 
"drug is toxic” is denoted by T and the event “the chemical test reveals that the drug is toxic" 
is denoted by C. If P(T) = Ө, P(CIT) (CIT)-1- Ө, show that the probability that the drug 
is not toxic, given that the chemical test reveals that it is toxic, is free from Ө. 

H is one of the six horses entered for a race and is to be ridden by one of the two jockeys J, or 
J,. Itis 2 : 1 that J, rides H, in which case all the horses are equally likely to win; if J, rides 
H, his chance is trebled. Show that the odds against his winning are 13 : 5. 

One and only one of A, B, C, D has committed a murder. On the basis of initial information 
any one of them had the same chance of committing it. None of them would plead guilty if in 
fact he was not guilty. Their respective chances of pleading guilty, having committed the 
crime, are judged to be 0.5, 0.4, 0.3, 0.2. All of them have pleaded not guilty. What is the 
probability that D did it. ? [Ans. p = 4/13] 
An urn contains a white balls and b black balls, another contains c white balls and d black 
balls. One ball is transferred from the first urn into the second, and then a ball is drawn from 
the latter. Show that the chance that it will be a white ball is [a(c * 1) * bcy/(a b) (c * d * 1). 
An urn A contains 3 white and 4 black balls and an urn B contains 5 white and 3 black balls. 
One ball is chosen randomly from A and transferred to B. Two balls are chosen without 
replacement from B. Show that the chance that they are of the same colour is 59/126. 

Urn A contains 6 white and 4 black balls and urn B contains 2 white and 2 black balls. From 
urn A two balls are transferred to B and a sample of size 2 is then drawn without replacement 
from urn B. What is the probability that the sample contains (i) Exactly 1 white ball ? (ii) Both 
balls are black ? (iii) Balls are of the same colour ? ` [Ans. 128A, 41А, 97А, А = 1/225] 
Urn A contains 10 white and 3 black balls, urn B contains 3 white and 5 black balls. Two balls 
are transferred from A to B and then one ball is drawn from B. What is the probability that it 
is (i) white ball, (ii) black ball ? [Ans. 59/130, 71/130] 
A box contains n, tags numbered n, and п, tags numbered 2. A tag is selected at random. If it 
is No. 1 tag, one goes to urn A which contains г, red balls and b, black balls and selects a ball 
at random; if it is No. 2 tag, one goes to urn B which contains r, red balls and b, black balls, 
and selects a ball at random. Find the probability that one obtains a red ball. 

The probability that a certain beginner at gold gets a good shot if he uses the correct club is 
1/3, and the probability of a good shot with an incorrect club is 1/4. In his bag are five 
different clubs, only one of which is correct for the shot in question. If he chooses a club at 
random and takes a stroke, show that the probability that he gets a good shot is 4/15. 

In a clubroom, there are 5 ordinary bridge decks aad 3 pinochle decks, all having similar 
construction and designs. One of these 8 decks is chosen at random, and a card is randomly 
drawn from it. If the card is jack of hearts, find the chance that it came from (i) a Pinochle 
deck, (ii) a Bridge deck. [Ans. p, = 13/23, p, = 10/23] 
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18. Urn A contains a white and b black balls, urn В contains b white and a black balls. Sta iting 
with the first drawing from A, a series of drawings 1s made according to the following rules 
(i) Each time only one ball is drawn and immediately returned to the same urn it came from 
(ii) If the ball drawn is white, the next drawing is made from A. 
(iii) If the ball drawn is black, the next drawing is made from B. 
What is the chance that kth ball drawn will be white ? Ip, 71 t + 71a - b)/ (a + b) f. 

19. (a) From a box containing 4 black and 6 red balls, 5 balls are giri! into an empty urn. 
From the urn, 3 balls are drawn and they happen to be black. Show that the probability that 
the fourth ball taken from the urn will also be black is 1/7. 
(b) There are 3 boxes containing red and white chips with r; red chips and w, white chips in 
Box j, 1 <j € 3. Two fair cons are tossed and one chip is drawn from the box corresponding to 
the number of heads showing plus 1. Prove that 

P(chips isred) = (r//4cj) + (rJ2c;) + er/4c), [с = rj з]. 

20. Two electric supply units A and B operate in parallel to meet the power requirements of a 
small city. Each unit has a capacity so that it can supply the city's full power requirements 
75% of the time, in case the other unit fails. The probability of failure of each unit is 0.15 that 


of both units failing 0.03. If there is failure in the power generation, find the probability that 
the city has its suppy of full power. 


2.20. Independence of Events 
Events A and В are said to be independent, [written : (A, В) or Ind (A, B)], iff 
P(AB) = P(A) P(B). 

Independence of three events A, B, C is defined by four relations. 
P(AB) = P(A) P(B); P(AC) = P(A) P(C), P(BC) = P(B) P(C) ; P(ABC) = P(A) P(B) PCC). 
A family of events is completely independent iff its every fintie subcollection of events 
is independent. 
In general, events А), Aj, ..., A, are said to be pairwise independent iff 

Р(А А) = Р(А,) P(Aj, for all i + у. 
Events A,, A,, ..., A, are said to be mutually independent iff 

P(A;A) = P(A) P(A), V i ј, ij. 

[x = P(A;) P(A) P(A), V i,j,k, i j = К. 
LL. Lx s pat 
P(A,A,, ..., А us P(A,) Ply), - PA»). 

Precisely, events А, are said to be independent iff for each finite set of distinct indices 
i, € A (index set), we have 

P(A, A sss AL) = P(A,) P(A,) .. PCA, ). 
Abbreviations. Sometimes the words, "independent" and "dependent" shall be written 
"indep" and “dep” respectively. 


lh, l5, sees 
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2-21. Number of Conditions for Mutually Independent Events 


If n events are completely independent, then every combination of n events, taken 
any number of times, should be independent. It follows that, the number of relations 


in the (n — 1) equations listed in (1) have (3). Bias) terms respectively. Thus, the 


total number of conditions among the relations (1) are 


n n n n n n| ^n 

e +--+ (") = (1+1) – (0-0) =2 үү 
2-22. Independence versus Mutual Exclusiveness 
(i) A and B are (proper) mutually exclusive events and 
P(A) - P(B) > 0, then they cannot be independent. 


(ii) If A and B are (proper) independent events and 
P(A) . P(B) > О, then they cannot be mutually exclusive. 
Proof. We are given that P(A) = 0, P(B) » 0, i.e. 
P(A) . P(B) > 0. 
(i) If events A and B are disjoint, AB = @ and so P(AB) = 0 # P(A) . P(B) > 9. 
It follows that, A and B cannot be independent events. 
(ii) If A and B are independent events, then P(A N B) = P(A) P(B) > 0. 
Thus P(A f| B) = 0. Hence A and В cannot be disjoint. 
Comments. Events A and B have to be proper [P(A) # 0, P(B) # 0], otherwise A = Q, 
B=, 0 ПО = © so P(O [| О) = Р(@) P(Q) = 0, is true, so that disjoint events are 
independent. 
Further Ind (A, B) +> P(A | B) = P(A), because conditional probability is not defined for В = Ø. 
Remarks. Events can be dependent without being disjoint. In fact, the disjoint sets of 
events can be depicted as a subset of the dependent sets of events of the sample space. 
[See figure]. Independence and mutually exclusiveness may be persent in the same problem : 
Illustration. Define the events for a single roll of a die : A = {1, 3, 5}, B = {2, 4, 6}, 
C= {5, 6} 
Then, АПВ 9, B(1C = {6} z 2. Now, 
(i) P(AB) = 0 # P(A) P(B) = 1/4. Thus A and B are disjoint but not independent. 
(ii) P(B N C) = +=5=4=P(B).P(C). Thus B and C are independent but not disjoint. 
Example. A single card is drawn from an ordinary deck. Give examples of events 
A and B associated with this experiment that are 
(a) mutually exclusive (m.e.) but not independent (indep.) (b) indep. but not m.e. 
(c) indep. and m.e. (d) neither indep. nor m.e. 
Solution. We define the following events : 

S = (Spade is obtained), H = (Heart is obtained}, A = (Ace is obtained}, D = (SU HJ 
(a) P(S N H) = 0 = P(S) P(A), (b) PAS ПА) = 1/52 = P(S) P(A) = [(1/13) (1/4)] 
(c) Class of m.e. and indep. events is disjoint. 
(d) P(S N D) = P(S) = 1/4, P(S) . P(D) = (1/4) (1/2) = 1/8. 
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2-23. Some Theorems Regarding Independence 


r M " ` ^n 
Theorem 1. If A and B are independent events, ther 


(i) Aand B are independent. (ii) A and B are independent, (iii) A and B are independent 


Proof. Since A and B are independent, we have P(A N B) = P(A) Be» c1) 
Also P(C(1D) = P(C) -P(CD). [Subtractive law] ЗОЛ 
(0) __ P(AB) = P(A) - P(AB) = P(A) – P(A) P(B) [by (1) and (2)] 

= P(A) [1 — P(B)] = P(A) . P(B) [by Complement Rule] 
(ii) P(AB) =P(B) – P(AB) = P(B) - P(A) P(B). [by (1) and (2)] 

= Р(В)[1 - Р(А)]= P(B) .P(A) = P(A) P(B) [by Complement Rule] 
(iii) P(ANB) 21 – P(A U B) [by Complement Rule] 

= 1 – [Р(А) + P(B) – P(AB)] [Union of 2 events] 

= 1— P(A) — P(B) +P),P(B) [by (1)] 

= [1- Р(А) [1 - P(B)]= P(A) P(B). [by Negation Rule] 
Aliter. P(A В) = P(A) – P(A B)= P(A) - P(A) P(B) [by (2) and (iii)] 

= P(A)[1 - P(B)]= P(A).P(B), [by Negation Rule] 


This means A and B are independent events. 

Comment. Perhaps it is now obvious that (A ; B) © КА; В) etc. Thus, the converse 
of theorem 1 is true, since (AĴ = A. 

Theorem 2. The following conditions are equivalent. 


(a) A, B, C are independent, (b) A,B,C are independent. 
(c) A, B,C are independent (d) A,B,C are independent. 
Proof. For two events A, B, Independent (А, B), Ind. (А, В), Ind. (A, B) are equivalent. 


This result shows that A, B, C are pairwise independent if A,B,C аге pairwise 
independent. This gives, ч 
P(A BC) = P(A) P(B) P(C) 


L.H.S. = P(BC – ABC) = P(BC) - P(ABC) = P(B) P(C) — P(ABC) 

К.Н.5. = [1 - P(A)] P(A) P(B) = P(A) P(B) — P(A) P(B) P(C) 
So Eq. (2) yields P(ABC) = P(A) P(B) P(C). 
Just show equivalence (a) <> (b). Then (a) = 
use of (a) €» (b). 
Theorem 3. If the events A, B, C are com i i 
(B, CA), (C, AB) also consist of a i арша онии 
Proof. Since А, В, С are completely independent, the follow; ati id 
P(AB) = P(A) P(B), P(BC) = P(B) P(C), P(CA) = P(C) , P(A), Som A io E. 1) 
For the pair (A, BC), we note that 

P(A(BC)) = P(ABC) = P(A) P(BC). 

Thus A and BC are independent. Others also follows trivially. 


ELT) 


(c) and (а) <> (d) follows by repeated 


[by [1(b)] and [1(d)] 
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Theorem 4. The event A is known to be independent of the events B, B U C and B f) 
C. Then A is also independent of C. 
Proof. We are given that, by independence, 

P(AB) = P(A) Р(В), P[A(BU C)] = P(A) P(BU C), P[A(BC)] = P(A) P(BC) ..(1) 
Now P(AB ЈАС) = P(AB) + P(AC) – P[A(BC)] = P(A) P(B) + P(AC) – P(A) P(BC)[by (1)] ...(i) 

P[A(B U C)] = P(A) P(B U С) = P(A) [P(B) + P(C) – P(BC)], [by 1(b)] ...(ii) 
Equating (i) and (ii) [because A(B U C) = AB U AC] we get 

P(AC) =P(A) P(C) = A is independent of C. 

Theorem 5. Let A,, A,, ..., А, be disjoint events and let В|, B,, ..., B, be also disjoint 
events. If events A; and B, are independent for every choice of i and j, then A and B are 
independent, where 


А = 0,4, В= Б.В, 1 <і<т, 1<і< т 


Proof. Here АВ = (04 )n(0 в |= Ü Ü A; B, and the events С, = A, В, are disjoint 
il jaro i=l j=! | 
[C; (| C,1 = 2]. Hence 


P(AB) = 2. 22 Р(А В,) = У У Р(А) ма-а) 5 Pæ] = P(A) P(B). 
i=l j=l i=l j=l i=l j=1 
Theorem 6. Probability of at least one of n independent events : 
Let A,, A», ..., A, be n mutually independent events, with P(A) = pj and P(A;) = q; 
[4; = 1 — р]. Now by Negation Rule | 


P(L) = P{A,UA, U...UA,}=1-P{ A, UA, U...UA, }=1- РІА, ПА, П... ПА. 
PPA, PUA, a. PUA) aden dg. [^ A, are independent] 

In particular if A and B are two independent events, and if L, = A U B, then 
P{L,} = 1- P(A) P(B). 

Comment. For independent events, this rule is very convenient. 


2-24. Conditional Independence of Events 
The events A and B are said to be conditionally indepedent, if given C 

PIAS TOTS PAC) PB WC); [or P(A | ВС) = P(A | C)]. 
The notion of conditional independence can be extended to more than two events. 
Illustration. Company C, produces on the average one defective tube per 100 tubes 
and company C, produces only one defective tube per 200 tubes. A box received 
from C, or C, is opened, a tube checked and it is non-defective. Find the probability 
that the 2nd tube checked shall also be non-defective. 
Solution. Let T, = (First tube is non-defective}, Т, = (2nd tube is non-defective}. Let 
C= 1, 2) denote that the box received is from company C,. We express our aprori ignorance 
by setting P(C,) = 1/2 = P(C,). Now if T denotes a non-defective tube, then given data is 


Р(ТІС) = 001, P(T1C,) = 0.005. 
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So by Multi-stage Rule 
P(T,T,) = P(T, Т,\ C) РОС) + PCT, T,1 C) PEC) = 3 (99/100) + (199/200) | 


РСТу) = P(T, ІС) РОС) + P(T, 1 Cy) РСС) = + (099/100) + (199/200) } 
P(T,\T,) = P(T,T,/P(T,) = [(198)° + (199) (198 + 199) x 200. 4 
Comments. Here, states of successive tubes аге cond. independence Р(7, T IC, = P(T, IC) PIC) 


These states are not independent. P(T, | T,) # Р(Т,) = P(7)). 
The topic of conditional independence is of growing importance. 


2-25. Worked-Out Problems 


Example 1. Give examples of three events which are : (i) Independent in pairs but 
not mutually independent, (ii) Independent three-wise but not independent. 


Solution. (i) Define the events relating to throw of two dice D, and D, : 
A = {even numbers on D,}, B = {odd numbers on D,} 
C = {both even numbers or both odd numbers}. 


P(A) = P(B) = P(C) = 4, P(AB) = Р(ВС) = P(CA) = 1. 
Obviously, events A, B, C are pairwise independent events. However, since A (] B N C= Ø. 
P(ABC) = 0 so that P(ABC) # P(AB) P(C). Thus AB is not independent of C. 


(п) Let Q = (1, 2, 3, ..., 16] ; Р(е,) = 1/16; 1 <i < 16, e; є О and consider the events 
A= 41, 2, 3, 4, 5,6, 10, 15], 8 = {1, 2,3, 4), and C5 (5,9; 8, TT TANS, 16). 


The various combinations are: А ПВ = В, А ПС = {1}, BN C= (1, AQ BN C= {1}. 
1 P(A) P(B); Р(ВС) = $ + P(B) (C) - 1.1, 


P(AB) 


P(CA) = i; P(A) P(O); P(ABC) = £ = P(A). P(B) . P(C). 
Thus, no two of A, B, C are independent although P(ABC) = P(A) P(B) P(C). 
Example 2. (i) If A and B are independent events and A c B, prove that either P(A) = 0 
or P(B) = 1. 

(ii) If an event A is independent of itself, (i.e. A and A are independence) show that 
P(A) = 0 or P(A) = 1. 

(iii) If P(A) = О or 1, show that A and В are independence for any event B, in particular 
A and A are independent. 

Solution. Here : P(A П B) = P(A) P(B) [АА ; B)] ET 
(i) Since A c A, we get A f] B =A, and (1) provides P(A) [1— P(B)] = 0 => P(A) = 0 or 
P(B) =.1. 

(ii) Since A [1 A =A, Eq. (1) reads P(A) = P(A) . P(A) 

so that P(A) [1 — P(A)] = 0 => P(A) = 0 or P(A) = I. 


$2-25. Worked-out Problems 71 
(iii) Let P(A) = 1. Since A U B DA, we do have P(A U B) > P(A) = 1. 
Since probability measure cannot exceed unity, this realy reads : 
1 = P(A UB) = P(A) + P(B) – P(AB) = P(B) = Р(АВ). 

So P(AB) = 1. P(B) = P(A) . P(B) > I (A ; В) true. 
Let P(A) = 0. Since AB c A, we do have P(AB) < P(A) = 0. 
Since probability measure is non-negative, this really gives 

P(AB) = 0 = P(A) P(B) = 0. P(A) P(B) = P(AB). 
This shows that A and B are independent. In particular, replacing B by A, we see that A 
and A are independent. 


Remarks. In general, A is not independent of A. Recall that ҚА ; B) => P(A | В) = Р(А!В). 


Hence if B = A, we get P(A | A) = 1 +0 = P(AIA). Thus, “Statistical independence” is 
not a “reflexive relation” on the event space. 

Example 3. Four events A, B, C, D, depicted in the following figure are with assigned 
probabilities. Show that these events are independent. [Regions representing events 
A, B, C consist of two subregions each separated apart. A may be ‘rains’ in two parts 
of a city with dry-spell apart]. 


Solution. It is convenient to label the events by subscripts so that left set is Aj, Bj, C, 
and right set is A,, B,, С,. Now 


P(A) = P(A,)+ P(A.) -1«i- 
P(B) = Р(В,) + P(B)-i«i 
P(C) = P(C,)+ Р(С,)=1+2=1 


^ oim ceri 
P(D) = Probability of regions inside D = 15 * 3673 


1 1 [fw 1 

P(AB) = P(A, B.) + P(A; s (10) (4 i-i 
tele а SON MEI 
кле) - ($3) 


(Lt) 
Р(ВС) = (36 +367018 18) 6 


P(AD) = P(A)=}; Р(Вр) = Р(В)= 1, P(CD)- P(C) = 5 
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| 
_ 1,121) p(ABD)- P(A В) = 15 
MARC) M26 008 АЙ d 
| » TEE 
P(BCD) = P(B, C) - ig: P(ACD) = P(AC)) = тє 


| 
P(ABCD) = P(A, В, Ci) = 36" 


The following results trivially hold 

P(AB) = P(A) P(B), P(AC) = P(A) P(C) , PAD) = P(A) РФ) 

РВС) = P(B) P(C), P(BD) = P(B) P(D), P (CD) = P(C) PP) 

P(XYZ) = Р(Х) P(Y) Р(2), all choices 

P(ABCD) = P(A) P(B) P(C) P(D). 

Thus, all eleven conditions are satisfied. 
Example 4. Prove or disprove : 
If events A and B are independent, then P(AB | C) = P(A LO). P(B | С). 
Alternate Statement. Show that, if A and B are independent events, they need not be 
independent when conditioned by another event C. 
Solution. We throw two regular tetrahedrons and define the following events : 
A = {First face odd}, B = {Second face odd}, C = {Total of pips odd}. 
We demonstrate the outcome o = (x, y} and the events as under : 


P(A) = $, P(B)=75. P(C) = 4, P(AB) = » 
P(A | C) = $. P(BIC)=%, Р(АВІС) - 0, ((x € AB) eC) 
Thus, P(AB) = P(A) P(B), but P(AB | C) + P(A | C) P(B | С). 
Example 5. If A and B are independent events, show that 
max {P(A U B) , P(AB), P(A AB)} > 4. 

Solution. Write P(A) = a, P(B) = b, then we need prove 
Р{(1 ~ а) (1-5), ab, a(l - b) + b(1-a)) > $ Ert) 
Suppose to the contrary that (1) is untrue, then this is 
max Pll =(2 + b) + ab, ab, a + b — 2ab} < + x1) 


9 
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By definition of maximum, (2) yields 


1 -(a* b) tabs i, ab« $,a*b-2ab« 5 (3) 


From 3(ii) and 3(iii), a+b<(#)= + 


Ѕо0а+Ь < (5) апдіаһ< 2 => a+(4a)< + 


Qa -12a+4<0 > | (3a-2y «0. 
This is absord, since a is real. Thus we reject (2) and accept (1). 


Note that 3(i) and 3(ii) provides ab < i different from ab < UT 


Infact regions a + b < ES ab « F, 0 « a, b< 1 have no points, empty region. 
Example 6. A player tosses a coin and is to score one point for every head and two 
for every tail. He is to play on until his score reaches or passes n. If p, is the chance 


for attaining exactly n, show that p, = 1(p, , + p,.;) and hence find the value of p,. 
Solution. Let S, denote the score is n and H, T denote head and tail, Then P(H)- 
P(T) = +, P(S,) = p,. Now S, can be attained by throwing a tail preceded by S, or by 
throwing a head preceded by S, ,. Thus $, 2 (S, ,(1 H) U (S, 4,7. 

. P($) = P(S, П.Н) + Р(5, (Йй) = PCS, ) P(A) + PCS, _ 5) Р(Т) 

En (pt)! . ah) 
To find p, explicitly, we rewrite (1) as 


2p, РАЗ a + p,-20f 2p, 4.27 Pn t Pw 
with E as extension (or shift) operator, this is expressible as 
СЕЕ Dp =. 


The roots of the characteristics equation : 2E - E- 1 =0 are E = 1, -1. Hence 
p, =а(1)" + b(-1)' = (a + b) (- 1" 
Now p,=P(S,) = 1,р, = Р(5,) = 5, һепсеа = 4,b= 
Py = (3) +01) 2)". 


Example 7. Occupancy Problem. Suppose b distinct balls аге randomly distributed 
among N distinct boxes, write 


E' = (no box is empty, i.e. all boxes are occupied} 


1 
3° 


ie = {Exactly m boxes remain empty} 
N b 
Then, Р(Е) = У, -Iy (үп 
r=0 n 


пам «(zv ("|") 
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Solution. First Part. First ball has N chocies to land in a box. Infact, E each 
has N choices to land. Thus b balls can be distributed among N boxes in (№) ways. Let 
E; denote the event that ith box is empty. Then, we fill the remaining N — 1 boxes by р 
balls, so that P(E) = (N - DIN). If two boxes are kept empty, then 


b b 
P(E, E) = (N — 2) (N),, (i + j). Similarly, P(E; E; Ej) = (№ — 3) /(М)”, etc., 
Thus, with usual notation 


NIS ^ My) o 
$, t ze) = (1) res jos pr EPL, E)-(3 BAV 


b 
N N Way (м). 
$, == 2106 E; E (N^ ы” r L N 


P(no empty box) = 1 – P(atleast one empty box) = 1 – P(E, U £, О... U Ej) 


P(E') 


r 


N | М 1 М b 
1 (51-5, + 53 ..+ CD" Syl = DEVS, = У CD w 91 
3 r=0 ma 
Second Part. For any specific group of m empty boxes, we have 
p= P(E, Ey... E, En.) E, 42 Ey), [Write E = Е, E>, ..., Е, and apply Product Rule] 


PIE EM E, =P) PRED, oe | E). [Now Apply Negation Rule] 
P(E) [I zz Pt (Eo U ET SUELE] 

For smooth notation, write Е, , = D, E,, 4, = Dy, ... Eco 
where М = № – m. Now apply Poincare's Rule to get, 


M 


p' = P(E) (1-(5, 595,4 5, - CIUS ри as = EDD ...D1E},......(1) 
Note that E — m boxes empty, m (m + 1) boxes empty, ED, D, = (т + 2) boxes empty, ... 
P(E) =(М- т)”, = [1 – (miN) [Part 1] 


_ PED) _[N-(m+P IN’ ү үү 
PO Э асъ (№ — my 1 №" (1-5) EB 
_ FED, Dj) {N - (m 2) /N^ 23 
P(D, D,VE) = P(E) (N — m)?/N? -( a 


(-4) 


Substituting from above results into (1) gives 


r- Ea) (Da) 9-3) corns) >| 
= (HY e (06-32 ] 


P(D, D, ... D, VE) 
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For any group (not a specific group) of m empty boxes, p = (“ҮР and using 
т) 


М = N – т, the above yields 
N N-m k N- m` т + k 
M 2, (C) | К Ji N | 


b 
N m п! (N-m k { 
p- | ) (1) | c» | MET 
m N 2 E N-m k=0 


А Ш (М k 
Remarks. P(E) =P{m = 0} = P(No box is empty} 2. (CD p Ji -5 ] 
k=0 ` 
| N-1 N k b 
P{ Atleast опе box is empty} = 1 - P(E’) = У CD** po 2j 
к= 1 


Problems with Solutions Provided at the End оў the Text 


1*. Given P(A U B) = 5/6, P(AB) = 1/3, P(B) = 1/2, determine P(A) and P(B). Hence 
show that events A and B are independent. 

Zee hear(A) =p, T STS5, 0 € p,, I. Pair-wise independent events A,, A5, A, satisfy the 
property : АА, = A,A, = АА, = A,A,A3. Show that these events are not independent. 

3*. Let A, B, C be three events. Show that Ind. (A ; B) and Ind. (B ; C) do not imply 
Ind. (A ; C). That is, the relation “independent of" is not a transitive relation on 
the event space (o-algebra). 

4*. Of three events A, В, C suppose that P(AB) = P(A) P(B); P(ABC) = P(A) P(B) P(C). 
Show that AB and C are independent but A and C need independent. 

5*. Prove or disprove the following assertions : if A is indep. of B and A is indep. of 
C, then (i) A is indep. of B U C, (ii) A is indep. of B Uc. 

6*. If events A, В, C are indep. with P(A) = p, P(B) = 4, P(C) = r, find the probability 
that atleast two will occur among the three events. 

7*. Let A and B be indep. events. Prove or disprove : A U B and A f) B are indep. events. 

8*. Ifthe event A is completely independent of events B and C, then A is independent 
of the logical sum B U C. 


9*. (a) Events A and P are such that P(A) — 1, РВІА) = 1, Р(АІВ) = 1. 


Prove or disprove the following statements : 
(i) A and B are mutually exclusive. (ii) A is a subevent of B. 


(iii) P(A1B) 23/4. (iv) Р(АТВ) + Р(А1В)=1. 
(b) If A is indep. of B and B is indep. if C and also A is indep. of BC, prove that C is 
indep. of AB. 


10*. For independent events A, B, C let 

P(A) =a, P(A U В О = =, Р(АВС) = 1 ~ с, Р(А'В' С) = х. 
Show that the probability х satisfies the condition 

аха: Лара) (4 +e о Ра) (> с) = 0. 


Deduce : c > [(1 - a) + ab]/(1 — a). 


LJ 


...(A) 
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12*, 


13*, 


14* 
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A problem is given to three students А, В, С whose chances of solving it are 
к UP 9 
1,4,4 respectively. What is the probability that the problem 1s solved ? 


A can hit a target 3 times in 5 shots, B : 2 times in 5 shots, C : 3 times in 4 shots. 
They fire a volley. Find chance that : 

(a) 2 shots hit, (b) At least 2 shots hit, (c) Exactly one of them hits. 
If only one of them hits the target, what is the chance that it was the first man ? 
And if two hit, what is the chance that it is C who missed ? 

Events A,, A, ..., A, are independent with P(A,) = p,. Find the probability p that 
none of the events occurs and show that p < exp (Zp). 


. From the set S = (1,2, ..., N}, r subsets Ay, Ач A, аге selected in independent 


trials such that P(x, € A; c S} = p, (q; = 1 — р). Find the probability that the 
subsets А„ 1 <i € r do not intersect pairwise. 


Exercise 2(b) 


Assume that none of the events has zero probability. Prove or disprove. 


(a) Р(АТВ) > P(A) 2 P(BIA) > P(B) (b) Р(АТВ) > P(A)  P(AIB) < P(A) 

(c) P(A IB) 2 P(A) 2 Р(ВІА) > P(B) (d) (A ind B) => P(ABIC) = P(A | С) P(BI C) 
(e) Р(АТВ) = P(B) = (A indep. B) (f Р(ВІА)= P(BI A) = (A indep B) 

(g) P(A)= P(B) = P(A|B)=P(BIA) (h) P(AIB) Р(В1А) = P(A) = P(B). 


(i) For any event A, prove that (a) A and ф are endep., (b) A and S are indep. 
(ii) Suppose A, B, C are independent events. Prove that 
(a) P(BIAC) -P(BIAU C) = P(B), (b) Aand (BA C) are indep. 
(a) Let A and B possible outcomes of an experiment and suppose that 
P(A) 0.4, P(B) - p, P(A U В) = 0.7. 
Find p if : (a) A and B are disjoint, (b) A and B are independent. 


Find p if : (c) A is subevent of B. (d) P(A | B) = 0.4. [Ans. 0.3, 0.5, 0.7, 0.5] 

(b) Find P(A), P(B) and P(C), where mutually Indep. events A, В, C satisfy the relations : 

P(AB) = V6, P(BC) = + P(A), 3P(B) = 1 P(C). [Ans. 1,5, 1] 

(c) Events A,, A,, ..., A, are ишу independent with P(A) = 1 - (Маў, 1 <] < п. Prove that 
-n(n* | 


P(A, UA,U...Ua,)=1-(a) 
(a) An experiment consists of tossing a coin and a die. If H is the event that head comes up 
in tossing the coin and D is the event that 3 or 6 comes up in tossing the die, find the 


probability for the following events : P(H), P(D), P(HD), Р(НІР), P(H U D). 


1 6 
(b) A coin is tossed 3 times. Show that the chance of getting head and tail alternately, is i à 


(a) The odds against A solving a certain problem are 4 to 3, and odds in favour of B solving 
the same problem are 7 to 5. Show that the probability that the problem is solved is 16/21. 


[Note. Odds is favour a ; b means p = a/(a + b), q = bl(a + b)]. 


10. 


Exercise 2(b) Г 7 


(b) The odds against a certain event are 5 : 2 and odds in favour of another independent 
event are 6 : 5. Show that the chance that 

(i) One at least of the events will happen is aá ‚ (ii) none of the events shall happen is # 

(c) The odds that a book is favourably reveiwed by three independent critics are 5 : 2, 4: 3, 
and 3 : 4 respectively. Show that the chance that of the three critics, a majority is favourable 
to review, is 209/343. 


с ual | А ; - ae | F 
The probability that a teacher will give an unannounced test during any class meeting i5 7. Ifa 


student is absent twice, show that the prob. that he will miss at least one test is = 


А town has two doctors A and В operating independently. If the probability that doctor А 15 
available is 0.9 and that for B is 0.8, show that the probability that at least one doctor 15 
available when needed, is 0.98. 

(a) If p is the probability that a man aged x will die in a year, prove that the probability that 
out of men М М». M, each aged x, M, will die in a year and be the first to die, is (1 – q )/n. 
(b) The probability that a husband will live 15 more year is 4 , and that his wife will live 15 


more-more years is i. Find the probability that in 15 years hence, (i) both will be alive, 


(11) neither will be alive, (iii) at least one will be alive, (iv) only the wife will be alive and 


(v) only the husband will be alive. oe md x 


(a) A problem is given to five students A, B, C, D, E. Their chances of solving itare 7,7. т, 1. = 
respectively. Show that the chance that the problem will be solved is 0.85. 

(b) A language class has only three students A, B, C and they independently attend the class. 
The chances of attendance of A, B, C on any given day аге 2, 1 and + respectively. Prove 
that the chance that the total number of attendances in two consecutive days is exactly 3, is - с 
(а) Two gunners бге on shot each. The chance of the first gunner getting а hit is 0.7 and that 
of second getting a hit is 0.6. Show that the chance of at least one scoring a hit, is 0.88. 

(b) One shot is fired from each of the three guns. Let G; denote the event that the target is hit 
by ith gun, i= 1, 2, 3. If P(G,) = 0.5, P(G,) = 0.6, P(G,) = 0.8 and С, are independent events, 
prove that the probability that (i) Exactly one hit is registered is 0.26, (ii) At least two hits are 
registered is 0.70. 


(c) When soldiers fire at a target, the chances that they hit the target are: + for A, + for B, = 


for C, $ for D. [A, B, C, D are soldiers]. If all the four soldiers fire at the target simultaneously, 


show that the probability that the target is hit by some one or more is 0.58. 

(a) The outcome of an experiment is equally likely to be one of the four points in 3-dim. 
space with coordinates (1, 0, 0), (0, 1, 0), (0, 0, 1) and (1, 1, 1). Let A, B, C be the events : 
x-coordinate = 1, y-coordinate = 1, z-coordinate = | respectively. Show that the events A, B, 
C are pairwise independent. 

(b) An urn contains four tickets marked with number 112, 121, 211, 222 and one ticket is 
drawn at random. Let A; (i = 1, 2, 3) be the event that ith digit of the no. of the ticket drawn is 
1. Prove that the indep. of the events A,, A, Аз, is pairwise. 

(c) Anurn contains eight tickets marked with numbers 111, 121, 122, 122, 211, 212; 212, 
221 and опе ticket is drawn at random. Let A; (i = 1, 2, 3) be the event that ith digit of the 
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numbers on the ticket drawn is 1. Show that A; are not pairwise independent although 

P(A A-A) = P(A,) P(A) P(A3). 

(d) The faces of a regular tetrahedron are coloured as red, green, black and all these colours 

on the remaining face. Let R, G, B be the events that the face which appears at the bottom, 

when the tetrahedron is thrown, has the colour red, green, black respectively. Show that the 


event R, G, B are pairwise independent but are not totally independent. 
j E! : 
11. (a) Of three independent events, the probability that the first only should happen is ~, the 
probability that the second only should happen is Е and the probability that the third only 


should happen is TE Show that the (unconditional) probabilities of the three events are 


$, 2: : respectively. 
(b) Of three independent events, the chance that the first only should happen is a, the chance 
of the second only is b and the chance of the third only is c. Show that the independent 
chances of the three events are respectively. a/(a + x), b/(b + x), c/(c + x) where x is the root of 
the equation (a + x) (b + x) (c + x) = x. 

12. If A and B are independent events such that AB c C, and А B c C, show that P(A) P(C) € P(AC). 


2-30. Huyghen’s Problem 
This is a class of problems whose solutions ultimately depend on an infinite geometric 
progression. We illustrate the process by a few problems : 
Example 1. Two players A and B alternately roll a pair of unbiased dice. A wins if on 
a throw he obtains 6 before B gets 7 points, B winning in the opposite event. If A starts 
the game, prove that his chance of winning is 30/61. 
Solution. Probability p of getting sum 6 with two dice is 5/36 and sum 7 has prob. 
6/36. Denote by A | a the event that A starts (takes turn) and A wins. Obviously, A wins 
on the odd-numbered attempt, thus if suffixes denote trial number, then A wins on : 
(Ala) =A, U AB, A, © AB, A,B, A, U ... [ A.B; independent] 
Now Р{АВ, AB, «By Asi) = 44  dd'  qd' . p = (qq) p 
where q = 31/36 (A does not get sum 6) and q' = 30/36 (B does not get sum 7). 
C Tk LEE 1 SE: 1 ЖУЗЕ) 
РДА kak = 2,04 P= PT а 7 3e TG x 57516) ^ 6T 
Example 2. A, B, C toss a coin in the order mentioned. The first one to throw a head 
(prob. p) wins. Assuming that the game may continue indefinitely, find their respective 
chances of winning. 
Solution. Let symbol a denote that A starts, then A | a, B | a, C | a may denote that A 
wins, B wins, C wins where A started. If suffixes denote trial numbers, then 


The probability of getting head is p and if tail is д = 1 — p. 
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Now A can win on Ads + 1)th trial, O < k < oo, and B can win on (3k + 2)th trial, O < k < œ. 


P(Ala) - E = р.[1/(1- q?)] 


Similarly, P(A\B,C, ...Cy Ay. 1А) = 41р => P(Bla}= Y pa” = pa / 0-41. 


К=0 
P(Cla) = 1 – {P(A | a) + Р(В\а)} = 1 – [pl - $)] – [pq — q)] = pg - 4). 
For the fair coin, р = 1/2, and then P(A | a) = 4/7, P(B | a) = 2/7, P(C | a) = 1/7. 
Moral. The starter always has an edge over his rivals. 
Example 3. A coin is tossed until for the first time the same result appears twice in 
succession. To every possible outcome requiring n tosses, attribute probability (1/2)". 
Find the probability that (i) the experiment ends before the 6th toss, (ii) ап even (odd) 
number of tosses is required for the experiment to end. 
Solution. Here Q = (hh, tt, htt, thh, hthh, thtt, hthtt, ...) where [h = head, t = tail] 
By hypothesis, p, = P(X = n) = (1/2)", where X is the number of tosses required. 


Observe that : P(Q) = (4) Ф (4) E (3) + .] = /(1—1)=1. 


15 


(i) p= P{X <6}= ZP(X =k) =p, + р, + Py + Ps =7(4) es OE 15. 


(ii) Р(Х =even}= 23 P, -2Y Ja == PIX = odd] = УР Же -ÈG jt =4 


Example 4. A and B throw alternately a pair of unbiased dice, A beginning. A wins if 
he throws 7 before B throws 6, and B wins if he throws 6 before A throws 7. If A | a and 
B | a denote the events that A wins and B wins when A starts, etc. show that : 


(i) P(Ala)=2+2P(AlD). (ii) P(Alb)- à P(Ala) 


(iii) P(Bla) = 2 P(BIb) (iv) P(BIb) = = + 3; P(Bla). 

Hence or otherwise find P(A | a) and P(B | a). Also comment on the result : 
P(Ala) + Р(В (а) = 1. 

[Note. This problem outlines the recurrence relations as an alternative to an infinite GP}. 

Solution. For 2-dice sum, P(S,) = (6 -17 – k I}, so P(S,) = 5/36, P(S) = 6/36 = 1/6. 

(i) By Multistage p-Rule : A, = (A wins when A starts}, etc., $, = A's winning score, etc. 


P(A) =P(S,) P{A,1S,} + P(S,) PIAIS SIS = Sr S575] 0) 
P{A, 1 S,} = 1, P(A,1S,) - P(A,). because P(A,1$,) is the probability that wins 


but after the first trial. But at trial 2, A becomes the second player. Hence (1) yields 
P(A,) = (1/6) . 1 + (5/6) PIA. 
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(11) 


P(A, | $5) = P{A wins at B's tum when 5; happens] 


(111) 


Now 


(iv) 


P(A,) = P(S,) P(A, | Sp) + P(Sa) P(A, | Se ) 
= 0, P(A, 5,)= PU, ), P(S, j= (24) 


P(A,) = (3D) PA). 


36 
P(B) = P(S,) P(B,AS,)  PG4) Р(В,154) 
Р(В,15,) =0, Р(В,15,) = Р(В,), PS) = $ 
P(B,) = (5/6) P(B,). 
Р(В,) = P(S,) Р(В,15,) + P($5) Р(В,15,) 


.Now Р(В,15,} = 1, Р{В,1$»}= P(B,), ($5) = P(S) =з 


From (1) апа (ii), P(A,) = 


From (ii) and (iv), Р(В,) = Me 


P(B,) = (с) + С) PG,) 


iv $31 _ 36 
Giese = P(A) = є 
5 31 25 
36 3 pq => P(B,)= T 


Obviously, P(A,) + P(B,) = 1, which is otherwise obtainable by Negation Rule. 


Exercise 2(c) 


A and B take alternate turns in throwing a coin, the first to throw head being awarded a prize. 
Show that if A has the first throw, the chances of their winning are in the ration 2 : 1. It is 
assumed that the game is continued till one of the players wins it. 
A and B alternate shots in a dual. The probability of A hitting B is p, and probability of B 
hitting A is р,. If A fires first, show that the chance that A wins the dual is p,/(1 — 4,95). 
An urn contains a white balls and b black balls. Two players draw balls out of it in turn, one 
ball at a time and each time return the ball to the urn. Show that the chance that the player 
who starts will first get a white ball is (a + b)/(a + 2b). 
A and B take turns in throwing 2 dice, the first to throw 9 being awarded the prize. Show that 
if A starts, their chances of winning are in the ratio 9 : 8. 
A man alternately tosses a coin and throws a die, beginning with a coin. Show that the chance 
that he will get a head before he gets a “5 or 6" on the die is 3/5. 
A. B, C, D cut a peak of cards successively in the order mentioned. What are their respective 
chances of first cutting a spade ? [Ans. 642, 48A, 364, 274, A= 1175] 
A, B, C alternate firing at a target in this order. The probabilities that A, B, C strike the target 
are ру, p» p, respectively. Assuming Bernoulli trials, show that the chance that A will hit the 
target first is p,/(1 — 4,4243) and the chance that B will hit the target first is 

а\рә/(1 — 91943) .[q 2 1 - p]. 
N players A), --., A, throw in the order mentioned, a biased die whose probability of a six IS р. 
The first one to throw a six wins. Show that P(A, wins} = pq - !(1-q*,1xkxsN. 


$2-50. Baye’s Reversal Rule _ 8 1 


2-40. Successive Trials 
_ If an event A occurs at random on an average once in time /, the chance that A does 
not occur in given time 7 is e'lt. 

Proof. Divide every unit of time in n intervals, n being very large. Then in the periods 
t and T, there shall be nt and nT such intervals. Consequently, P(A) = 1/nt, since A 
happens in one interval out of nt intervals. 


Now, for a single interval P(A) = | - (I/nt) = q. If A does not occur in the entire set of 
nT intervals, then its probability is q . q ... q [these are nT terms] = (4)"'. Hence, 


nT 
P{A does not occur in time Т} = lim (i=) pb [by Euler's limit] 


n>o nt 
Example 1. If war breaks out on the average, once in 25 years, find the probability 
that in 50 years at a stretch, there shall be no war. 


Solution. Divide the period of 25 years into an indefinitely large number, say, 7 equal 
intervals. Then, the probability of a war in any of these equal intervals, assumed equi- 
probable, is р = (1/n), whence that of no war breaking out is q = 1 — (1/n). Now the 
period of 50 years gives rise to 50 x (n/25) = 2n, equi-probable sub-periods. Hence 
the probabiliy that there will be no war in the next 50 years is (4.9 .... q) which are 2n 
terms, i.e., q^. Thus for large n, 


2n 
P = lim (q^) = lim (1-4) =e", [by Euler’s limit] 


Ho ' n—»o0 


Example 2. If 30 D.T.C. buses per hour pass University Campus, what is the chance 
that in the next 10 minutes none will pass ? 


Solution. Here t = 60/30, T = 10, hence P(No bus passes) = e ^ = e? = 0.00674. 
2-50. Baye's Reversal Rule 
LE Ase Acute Ay sare mutually disjoint events, with P(A) + 0, 1 < i € n, and if B is any 
arbitrary event caused by events Aj, sacked ; Ap with P(B) > 0, then 
P(A)P(BIA) | F(A)P(BIA) 

PB) ХР(А)Р(ВІА)` wd 


Proof. Since B c J; А, it follows that [See Figure 82-10], B = В П (9A) = UBA, by 
distributive law. Taking probabilities of both sides, using finite-additivity [P3'], we get 


P(B) = P(t} BA) = (Ва) = ХА) P(BIA), 1sisn ...(i) 
P(A; Г\ В) P(A,) P(BIA)) 
PE P(B) " 
Substituting for P(B) from (i) into Den. of (ii) we obtain the result 
P(A,) Р{ІВТА;) 
EP(A,) Р(ВІА,)' 


Note. Baye's Reversal Rule is also termed "Baye's Retrodiction Formula". 


P(A, B) = 


Now, by definition of conditional probability P[A, | B] = (її) 


Р{А,1В} = sien 


ence. Baye’s Reversal Rule 
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2-51. Baye’s Theorem for Future Events EL. E 

IfA., A, ..., A, are mutually disjoint events, ШОО уко, S. nme B is any 
м, à ned on the occurrence of event c. 


event, [P(B) > 0, Bc О Aj] which is, conditio 

[P(C > 0, C c UA,, then 

УРА) Р(СІА).Р(ВІСА) 12 jn. T 
EP(A) P(CVA) 

istributive law, B = B П Юд) = UBA), 1 <i<n 


(1) 
І 


P(BIC) = 


Proof. Since B є QA, we get, by D 
P(BIC) = P(OBA,IC) = EP(BA,| C) E. 

where we accept that P(* | C} isa bonafide probability measure and use finite additivity 

[P3']. Using the definition of conditional probability, we have 

P{BA, | С} = P(A,BC)/P(C) = P(A) . P(C |A) - P(B | CA,)/P(C), [by Product Rule] ...(1i) 

Since C c UA, so C= Cf) (ВА) = U(CA), hence P(C) = ХР(СА,) = УР(А,) P(C I A) (iii) 

with obvious use of Distributive law, finite-additivity axiom [P3'] and use of Product 

Rule. Substituting from (ii) and (iii) into (i), the result (1) follows. 

Cor. Suppose occurrence of А, makes B independent of C then P(BC | A;) = P(B | A) 

PLC TA). 

i P(BCA) = P(A) P(@BC IA) = РА) . (BIA) . CIA) [Conditional indep.] 

Also P(BCA, = P(CA) Р(В | СА) = P(A,) . P(CVA,) Р(В СА.) 

These provide : P(B | CA) = P(B | Aj) ; and using this result in (1) yields. 

EP(A,) Р(СТА;).Р(ВІА,) 
EP(A) Р(С\ А) 


We may regard event В as а future event in relation to event C. 


Р{ВІС} = sok Sh ft MN A 


2.52. Baye's Theorem for Repeated. Trials 
In n independent trials with constant probability p of success in each trial, r successes are 
observed. Probability p is not known but it is known that it takes one of the values pp Pr 
..., p, With P(p = p;) = % t= 1, 2, ..., К. Investigate P{a € p < B}, where 0 <a < р = " 
Proof. We designate the evens as under : 

A = (r successes in n trials], B; = {p=p},C={p:a<p<f},UB=5 
Using Multi-Stage Rule, and noting P(B) = à, i < i € К, we get 


К 
Р(А) = УР(В,) P(A\ В,) = 5") parr "(Papa |.) 


Using Bayes Reversal Rule, we get 


n urne 
P(A1B,) P(B,) (") рд © Р i " 
P(B.\ A) = == = ———— = Pidi Qj : (i) 
hose =й, — (by) it 


РОА). (“жна Фи 
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P(O 2 X Р(В\Ау= Xpiq' (ҮР "о. [p; + 4,7 1] 
pa р =а isl 

2.53. Worked-out Problems 

Example 1. A writes a letter to B and does not receive a reply. Assuming that one 
letter in n is lost in the mails, find the chance that B received the letter. It is certain that 
B would have replied the letter if he had received it. 

Solution. Define events : N = (A did not receive reply from В}, R = (B received the letter}. 
We need to find P{R | N}, where 


P(NIR)- |, P(NIR) = 1/n, P(R) = 1/n(loss in mails), P{R} = 1 — P(R). 
Now P(N) = P(R) Р(МІК) + P(R) P(NAR) 


= (1-2 n^) (IE/n) + (п). 1= Qn- D/n. 

P{R1N} = P{N | R}, P(RUYP(N) = (n – 1y/(2n – 1). [Reversal Identity] 
Example 2. Urns A, B, C have the following coloured balls : А : red, 4 white, B = 2 red, 
6 white; C : 1 red, 8 white. (i) An urn is chosen at random; a ball drawn turns out to be 
red. Find the chance that urn A is chosen. 

(ii) An urn is chosen at random; two balls withdrawn without replacement; both turn 
out to be red. Find the chance that urn A or B or C is chosen. 

Solution. Since urn-selection is equiprobable, P(A) = P(B) = P(C) = 1/3. Let К, indicate 
the appearance of j red balls. Then. 

P(R, | A) = 6/10, Р(К | B) = 2/8, P(R, | С) = 1/9. 


PCR, 1A) = ()(9) =4, PCR) 1B) - (2 (5) =, PR, 1С) =0. 


P(R,) = P(A) P(R, | A) + P(B) P(R, |B) + P(C) PR, 1 OC) = 173/540. [By Multi-Stage p-Rule] 
P(R,) = P(A) P(R, | A) + P(B) P(R, | B) + P(C) P(R,1C)=31/252. Ву Baye’s Reversal Rule 


| _ Р(А)Р(К ТА) 1 6 _ 173 _ 108 
SEIN MU. тз 


^ * cOPEAVPOC TAY 717179-- 28 - 
(ii) Р(АТА,) = TUER "3/252 731° Р(ВІК,) = 
P(C1R,) = P(R, 1 С) P(C)/P(R) = 0. 
Example 3. The contents of urns I, II, III are 1 white, 2 black, 3 red balls; 2 white, 1 black, 
1 red ball; 4 white, 5 black, 3 red balls respectively. One urn is chosen at random and 
2 balls drawn. They happen to be white and red. What is the probability that they 
come from urns, I, II or III ? 


Solution. Let U, = (urn i is chosen], A = {one white and one red ball chosen]. 


Here P(U,) = P(U,) = P(U) = 4 


PRIB) PB) 134 2 


PR)" 392522 21 


P(ALU,) = 1x3/(S)=1/5, P(AIU,) - 2x (2) =1/3 P(AU,) = 4x3/(7)-2/11. 
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P(A) = P(U,) P(AVU,) + P(U2) P(A | U5) + РФ) P(A! U,) = 118/495. [Multi-stage p-Rule] 


We now utilize Baye’s Reversal Rule to obtain 


P(U)P(AW,) _ 1/15 33. ES ÓOoumamse-2/35- 30 
— PA) 118/495 118" PUMA - 118/495 l8 — 118/495 118 
Note. P(U,\ A) = 1 - [P(U, | A) + P(U,14)]. 

Example 4. Guns | and 2 are shooting at the same target. Gun | shoots on the average 
nine shots during the same time gun 2 shoots ten shots. The precision of these two 
guns is not the same. On the average, out of 10 shots from gun 1, eight hit the target, 
and from gun 2, only seven. 

In the course of shooting, the target has been hit by a bullet, but it not known which 
gun shot this bullet. Find the chance that the target was hit by gun E. 

Solution. Let С, = (a bullet is shot by gun i}, i = 1, 2, and H = {target is hit by a bullet}. 
Taking into account the ratio of the average number of shots made by gun 1 to the average 
number of shots made by gun 2, we can write P(G,) = (9/10), P(G,) = (9/10)p, say. 
From the data relating to the precision of the guns, we have P(H | G) = 0.8, P(H | G,) = 0.7. 
^. P(H)=P(G,) P(H\G,) + P(G,) P(H | G,) = (0.9)p x (0.8) + p(0.7) = (1.42) p [Multi-stage p-Rule] 


Baye's Reversal Law now gives 


Р(О 1А) = 


P(G,)P(HIG,) (07p 35 _ 
P(H) ~ (142)p 71 dien 


P(G, | H) = 


Example 5. In a bolt factory, machines, A, B, C manufacture respectively 25%, 35%, 
40% of the total. Of their output, 5%, 4%, 2% are defective bolts. A bolt is drawn at 
random from the product and is found to be defective. What are the probabilities that 
it was manufactured by machines A, B and C ? 


Solution. Let A, B, C also denote the respective events that a bolt selected a random is 
manufactured by the machines A, B, C. Let D denote the event that a bolt is ‘defective’. Then 


P(A) = 0.25, P(B) = 0.35, P(C) = 0.40; P(D | A) = 0.05, P(D | B) = 0.04, P(D | C) = 0.02 
P(D) = P(A) P(D | A) + P(B) P(D | B) + P(C) P(D | C) [Multi-stage p-Rule] 
= (0.25) (0.05) + (0.35) (0.04) + (0.40) (0.02) = 345/(10) = 0.0345. 

The posteriori probabilities, (i.e. after information that item is defective) are obtainable 
from Baye's Reversal Law : 

P(A | D) = P(A) P(D | A)/P(D) = (0.25) (0.05)/(0.0345) = 125/345. 

P(B | D) = P(B) P(D | B)/P(D) = (0.04) (0.35)/(0.0345) = 140/345. 

P(C | D) = P(C) P(D | C)/P(D) = (0.40) (0.02)/(0.0345) = 80/345. 
Note. P(C1D) = 1 - [P(A | D) + P(B | D)]. 
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Example 6. A communication system transmits symbols 0, 1, 2 over a channel to a 
receiver. The channel often causes errors. Let В, and P(A. | B.) 
A. denote events that the symbols Before channel and В, : 
After channel are i and j respectively, (i, j = 0, 1, 2). 
Assume transmission apiori probabilities аге в, о ---->s.-----=~oA, 
Р(В,) = 0.5, P(B,) = 0.3 and P(B,) = 0.2 and transition 
probabilities are P(A, | В) = = 0.1, i + j and P(A, | B) = 
0.8, i = j. Compute the reception probabilities P(A) 
and the posteriori probabilities P(B, | А) for this system. 
What happens if all transmission probabilities are equal ? 
Solution. (1) The given data: Р(В,) = 0.5, P(B,) = 0.3, Р(В,) = 0.2 

P(A, | By) = P(A, | B,) = P(A, | B,) = 0.8 

P(A; | Bj) = P(A, | Bj) = P(A, | By) = P(A, | Bp) = P(A, | By) = P(A, | Bj) = 0.1. 

P(A,)=P(By) P(Ap| By) + P(B) P(Ag!|B,) - P(B,) (Ao B;) = (0.5) (0.8) + (0.3) 0.1) + (0.9) (0.1) = 0.45. 
P(A,) = (0.5) (0.1) + (0.3) (0.8) + (0.2) (0.1) 20.31, Р(А,) = (0.5) (0.1) + (0.3) (0.1) + (0.2) (0.8) = 0.24. 
Pd | Ay) = E DOS = 5 = 0.889. [Baye’s Reversal Rule] 
P(B, | A,) = (0.5) (0.1)/(0.31) = 5/31; P(B; 1 A,) = (0.5) (0.1)/(0.24) = 5/24 
P(B, | Ay) = (0.3) (0.1)/(0.45) = 1/15; P(B, 1 A) = (0.3) (0.8)/(.31) = 24/31. 
P(B, | Aj) = (0.3) (0.1)/(0.24) = 1/8; P(B, |A) = (0.2) (0.1)/(0.45) = 2/45 
P(B, | Aj) = (0.2) (0.1)/(0.31) = 2/31; P(B, 1A) = (0.2) (0.8)/(0.24) = 2/3. 
(ii) When all transmission probabilities are equal P(B) = 1/3, i = 0, 622580 

Р(А,) = (1/3) [Р(А, 1 Во) + Р(А, 1 Bj) + Р(А, | B,) = (1/3) [0.8 0.1 +.0.2] = 1/3. 
Similarly P(A,) = 1/3 and P(A,) = 1/3. This should be obvious in channel transmission. 
Now Р{В,1А,‚} = P(B,) P{A;| B}/P(A;) = P{A;1 B;} 
Thus, P(B,l Aj) = P{A, | В) = ОВИ =); P(B; | Aj} == ele Be 
Example 7. In answering a question on a multiple choice test, an examinee either 
knows the answer (with probability p) or he guesses (with probability д = 1 — p). Let 
the probability of answering the question correctly be 1 for an examinee whose knows 
the answer and 1/m for one who guesses (m being the number of multiple choice 
alternatives). Suppose an examinee answers a question correctly, whet is the probability 
Pm that he really knows the answer ? 
Note. Р, > р and sequence <p,,> is strictly increasing for m 2 2. 


Now p„- p= .mp _(m-VPI ү hence n, P. 
mp +4 mp + q 


р = = Жей „ Жш ae = > т 50 « p, >T. 
n*1 Pn = (m Dp + qlinp * d] Past? P 
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Solution. Let K, G, C denote the respective events that the examinee 
‘guesses the answer’ and ‘answer correctly’. Then, 

P(K) «p, P(G) = q, PLC) жй PC UG) e m. 
^. P(O) = P(K) P(C | К) + P(G) P(C1TG) 2 p. 1 + q( Im) = (тр + qm. [Multi-Stage p-Rule] 
Thus, P(K | С) = P(C 1 K) P(K)/P(C) = тр/(тр + q) [Baye's Reversal Law] 
Example 8. A box having n balls, was filled up in the following manner : 
An unbiased coin was tossed п times and according as it showed head or tail, one 
white or one black ball was put into the box. We draw m balls from this box, one by 
one with replacement, and observe that every one turns out to be white. Find p, „= 
P{Box contains only white balls}. Deduce that 

p, > [1 + е" > (1/2)" . (0 = т/п) 

Solution. Write W, = (Box contains j white balls, hence (л – i) black ones}. This amounts 
to j heads and (n — j) tails of n throws of the coin, hence 


P(W) = (^) (^^ ay - eu) isa sn (Warning : j + 0) ...(1) 


‘knows the answer’ 


J 


Let A = {m balls drawn from the box are all white}. In a box with j white balls among 
n balls, the probab of a white-ball extraction is (j/n) and for m white extractions in 
repeated independent trials, this probability is (j/n)". Hence 


P{AIW;} = Gin), Е 84 5 


= PW, РАТЬ) = У" 1) "EDI s(n) i)" 

pay = Seow ra wo- 2) (2) =a) ZU 

So P(W,,1A) = FAVW,). P(W,)/P(A) [Reversal Identity] 
Now P(A|W,) =1 (certainty) PW jet). [from (1)] 


РШ, 1А) = [sr ar 


This is the required probability. 
Approximation. For x > 0, (1 — х) < е" —[1- (n) < е". Now, 


n n i "un n n 22). di -jinym _ n (" RU b... 
EGE pu n <È j wed 2 (e^) - (0e) 
p(n, т) = (1+e°)" » (1/2) 

Since (1/2)" is the aprori probab. that the box contains only white balls. Note that 
p(n, m) > 1 as m > œ. 

Example 9. An urn contains N balls of which D are defective. A sample of n balls is 
drawn from the urn. Let A, be the event that the sample contains exactly k defective 
balls and B, the event that the jth ball is defective. Find (B; | A,) when the sample is 
drawn (i) without replacement and (ii) with replacement. — 
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Solution. à) PEAY = (0) ("= 2) (У), сд, в) = (2 NE DN), 


Let E, denote the event that exactly i defectives occur in the first (j — 1) draws, then 


^ fDY N-D М \ р-і 
е) = (ут Ui) 769 улт; 


j-1 тж , 
^ Р(В,) = E P(B, VE) PE pee vail N-D n N )= D [Multi-stage Rule] 
i-0 


So, 


(i) 


i Jj AULEM 


PCB \A,) = P(A,1B) P(BI(A,). [Baye’s Reversal Rule} 


ez E Gs) 


Ру)" 


(n) Dav - Dy-*. Bic AN =D)" 
а е) rr 


oN ј +1 а! 


Since the balls are repalced after each draw, P(B) = DIN, V j. Hence, by Baye's Reversal Rule, 


адреса р 
P(A,1B;) Р(В;) |M-l 


P(B.1A,) = be Nk 
MN P(A) DATEI ш, 
k (№)" 


Observe that the same result obtains in either scheme. 


P 


2". 


з=, 


4* 


Problems with Solutions Provided at the End of the Text 


If a toss of three dice gives a total of 9, what is the probability that this total was 
produced by three 3’s ? 

Coin C, is unbiased and coin C, is 2-headed and P(C, is chosen} = 3/4. A coin is 
chosen at random and tossed once. Find P(C, is chosen | head had appeared]. 
The chances of A, B, C becoming managers of a certain company are 4 : 2 : 3. 
The probabilities that Bonus Scheme shall be introduced if A, B, C become 
managers are 0.3, 0.5, 0.8 respectively. Find the probability that the Bonus Scheme 
will be introduced. 

If the Bonus Scheme has been introduced, what is the probability that A is 
appointed as the manager ? 

A bag contains an assortment of blue and red balls. If two balls are drawn at random, 
the probability of drawing of 2 red balls is five times the probability of drawing 2 blue 
balls. Further more, the probability of drawing 1 ball of each colour is six times the 
probability of drawing 2 blue balls. Find the number of red and blue balls in the bag. 
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Three urns A,, A,, A, contain respectively 3 red. 4 white, 1 blue ; 1 red, 2 м hite, 
3 blue; 4 red, 3 white, 2 blue balls. One urn is chosen at random and a ball is 
withdrawn. It is found to be red. Find the probability that 1t came from urn A,. 


In a certain college, the geographical distribution of men students is as follows : 50% 
come from the East, 30% come from the Mid-West, 20% come from the oe West. 1 he 
following proportions of the men students wear ties : 80% of the Easterners, 60% of the 
Mid-Westerners, and 40% of the Far-Westerners. What is the prob. that a student 
who wears a tie comes from the East ? From the Mid West ? From the Far- West ? 


Among three identical chests, one contains 2 black balls, one contains | black and | 
red ball and one contains 2 red balls. A chest is chosen at random and a ball is taken 
out. If it is red, what is the prob. that the other ball in the chest is also red ? 

A tells the truth with probability p and B with probability p'. 

(i) If they make the same statement, what is the chance that the statement 15 true. 
(ii) If A makes a statement and B says that A lies, what is the chance that A told 
the truth ? 

Of three identical boxes A, B, C, box A contains 1 white, 2 black chips, box B 
contains 2 white, 1 black chip and box C contains 2 white, 2 black chips. One of 
the boxes is chosen at random and one chips is drawn. It turns out to be white. 
Find the chance of drawing a white chip again, without replacements. 


Box A contains 4 red, 2 white and 6 black balls and box B contains 3 red and 5 
white balls. A fair die is tossed. If 1 or 6 appears, a ball is chosen from A, otherwise 
a ball is chosen from B. If a red ball is chosen, what is the chance that a ‘6’ 
appeared on the die ? 

Urn A contains 2 white and 2 black balls. Urn B contains 3 white and 2 black 
balls. One ball is transferred from A to B, and then one ball is drawn out of B. 
Find the chance that this ball is white. If this ball turns out to be white, find the 
probability that the transferred ball was white. 

A committee of 6n people contains half men and half women. A male is elected 
to choose, at random. From the remaining бл — 1 people, a committee of л 
people is formed. If the n people chosen happen to be of the same sex, find the 
probability that they are all female. 

Erom a vessel containing 3 white and 5 black balls, 4 balls are transferred into 
an empty vessel. From this vessel, a ball is drawn and it is found to be white. 
What is the chance that out of 4 balls transferred 3 are white and 1 is balck ? 


. The probability that a family has k children is P, (1 < k < n) and the probabilities 


for a family to have a boy or a girl are p and q respectively (p + q = 1). A family 
is known to include exactly one boy. Find the probability that the boy is an only 
child. Assume that p is constant for all families. 

Box A contains 4 red balls and 8 blue balls and box B contains 6 red and 5 blue 
balls. Two ball are transferred from A to B and then a ball is withdrawn from B. 
(i) Find the chance that this ball is red. (ii) Given that the ball withdrawn is red, 
find the probability that at least one red ball was transferred to B. 


16*. 


17*. 
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Urn A contains 9 cards pumbered 1 through 9 and urn B contains five cards 
numbered 1 through 5. An urn is chosen at random and a card drawn. If the card 
shows an even number, another card is drawn from the same urn but if the card 
shows an odd number, a card is drawn from the other urn. What is the chance 
that both cards show (i) even numbers (ii) odd numbers ? If both cards show 
even numbers, what is the chance that they come from urn A. 


An urn contains 5 white and 5 black balls, four balls are drawn from this urn and 
put into another urn. From this second urn a ball is drawn and is found to be 
white. What is the chance of drawing a white ball at the next draw, the first white 
ball drawn is not replaced. 


Exercise 2(d) 


Show that if all of the probabilities are conditional on another event C, Bayes Theorem still 

remains true. 

(a) A population consists of 60% males and 40% females, there being 5% men and 2% 

women are colour blind. A person chosen at random is found to be colour blind. What is the 

chance of this person being a male ? 

(b) Five men out of 100 and 25 women out of 10,000 are colour blind. A colour blind person 

is chosen at random. Show that the probability of his being male is 0.8. Assume that male and 

female are in equal numbers. 

(a) There are two identical boxes containing 4 white and 3 red balls; 3 white and 7 red balls. 
A box is chosen at random and a ball is drawn from it. Find the chance that the ball is white. 
If the ball is white prove that the probability that it is from first box is 40/61. 

(b) Urn A contain 2 white, 1 black and 3 red balls. Urn B contains 3 white, 2 black and 4 red 
balls. Urn C contains 4 white, 3 black and 2 red balls. An urn is chosen at random and 2 balls 
are drawn. They happen to be red and black. Show that the chance that both balls came from 
urn B is 20/53. 

(a) From an urn containing 3 white and 5 black balls, 4 balls are transferred into an empty 
urn. From this urn, 2 balls are taken and they both happen to be white. What is the probability 
that the third ball taken from the same urn will be white ? Consider the cases when the two 
balls drawn in the first draw are (a) returned, (b) not returned. [Ans. 7/12, 1/6] 
(b) A box contains 5 chips, and of these it is equally likely that 0, 1, 2, 3, 4, 5 are white. A chip 
is drawn and it is found to be white. Show that P(this is the only white chip} = 1/15. 

(a) Urns A,, A, each contain 2 white and 3 black balls. Urns B,B, each contain 1 white and 4 
black balls. Urn C contains 4 white and 1 black ball. An urn is selected at random and a ball 
is drawn. It is found to be white. Find the probability that the ball comes out of the urns of the 
(i) second composition, (ii) third type. [Ans. 1/5, 2/5] 
(b) There are 4 work-stationss of type A, each having 6 fitters and 3 turners and 3 work- 
stations of type B each having 2 fitters and 4 turners. One station is selected at random and a 
person is chosen at random from it. If he is a turner what is the probability that he came from 
type A station ? [Ans. 2/5] 

Three machines A, B, C with capacities proportional to 2 : 3 : 4 [actual output 20,000, 
30,000, 40,000] are producing bullets. The probabilities that these machines produce defectives 

are 0.1, 0.2, 0.1, respectively. One bullet is taken from day's production and found to be 

defective. Show that the probability that this bullet came from machine A or B is 5/6. 
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гїһе manufacture of screws, which may be 
y n, boxes of screws of which on an 
and р,. From the total 


In a factory, two machines : M, and M, are used fo 
uniquely classified as good or bad. M, produces per da 
average p,% are bad, while the corresponding numbers of M, are л, 
production of both M, and M, for a certain day, a box is chosen at random, a screw taken out 
of it and it is found to be bad. Show that the chance that the selected box is manufactured by 
M, is nyp,/([np, + п›р,). 

A building contractor receives bricks from three different sup i 
45% from supplier B and the rest from supplier C. 90% supply of A, 80% supply of B and 95% 
supply of C is according to specification. A brick drawn at random is not as per specification. 
Sho that the prob. that it came from B is 2/3. 

From an urn containing 5 white and 5 black balls, 5 balls a 
empty second urn from which one ball is now drawn. This is found to be white. Show that the 
probability that all 5 balls transferred from the first urn are white is 1/126. 

There are five urns and they are numbered 1 to 5. Each urn contains 10 balls. Urn i has i 
defective balls and 10 — i non-defective balls, i= 1, 2, ..., 5. An urn is chosen at random and 
a ball is selected from it. What is the probability that a defective ball is selected ? If the 
selected ball is defective, show that the probability that it came from urn 5 is 1/3. 

Bowl I contains 3 red chips and 7 blue chips, Bowl II contains 6 red chips and 4 blue chips. 
A bowl is selected at random and then one chip is drawn from this bowl. What is the chance 
that this chip is red ? If this chip is red find the conditional probability that it is drawn from 
Bowl II. If one chip is trnsferred from bowl I and placed in bowl II without seeing its colour 
and then one chip is withdrawn from bowl II, find the probability that it is a blue chip. 


[Ans. 9/20, 2/3, 47/110] 


Bowl A contains 6 red chips and 4 blue chips. Five of these 10 chips are selected at random 
and without replacement and put in bowl B which was originally empty. One chip is then 
drawn at random from bowl B. Relative to the hypothesis that this chip is blue, prove that the 
conditional probability that 2 red chips and 3 blue chips are transferred from bowl A to bowl 
B is 5/14. 

A coin is tossed. If it turns up head, 2 balls will be drawn from urn A, otherwise 2 balls will be 
drawn from urn B. Urn A contains 3 black and 5 white balls. Urn B contains 7 black and ! 
white ball. In both cases, selections are to be made with replacement. Prove that the chance 
that urn A is used, given that both the balls drawn are black, is 9(5)° [Ans. 149 + 9(5)6]. 
Mr. A chooses one of the coins C, (head-probability 3/4) and C, (head probability 1/4) and 
tosses the coin twice. Show that P{2 heads} = 5/16, P(heads only once) - 3/8. 

Instead of choosing C, or C,,A chooses a fair coin and tosses it twice. State the procedure A 
should adopt so as to maximize the probability of at least one head. 

An urn containing 5 balls has been filled up by taking 5 balls from another urn which 
originally had 5 white and 5 black balls. A ball is taken from the first urn and it is found to be 
white. Prove that the probability of drawing a white ball from among the remaining four is 4/9. 
Bowl I contains 4 red and 5 black chips and bowl II contains 3 red and 6 black chips. One 
bowl is chosen at random a chip is drawn its colour noted and replaced back to the bowl. 
Again a chip is drawn from the same bowl, colour noted and restored to the bowl. This 
is repeated four times, and the result yielded one red chip and 3 black chips. Prove 
probability that bowl I was chosen is 125/87. 
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(a) Three urns of the same appearance have the following composition : Urn I has 2 black 
and | white ball; urn II has | black and 2 white balls and urn III has 2 black and 2 white balls. 
One of the urns is selected at random and a ball is drawn. It turns out to be white. Prove that 
the chance of drawing a white ball again, if the first ball has not been returned, is 1/3. 
(b) Urn A contains | white and 2 black balls, urn B contains 2 white and | black balls and urn 
C contains 3 black and 3 white balls. A cubical die is tossed. If 1, 2, 3 or 4 shows up, urn A is 
chosen, if 5 shows up urn B is chosen and if 6 shows up, urn C is chosen. A ball is drawn at 
random from the chosen urn. Obtain the probability that it is white. 
Your host has arranged an unusual game for you and his other friends. Unseen by his friends 
his younger son spins a pointer which must stop in one of the three sectors, I of central angle 
of 144°, II of central angle 144° and III of central angle 72°. Also wunseen by his friends, his 
elder son throws a number of dice equal to the number of sectors in which the pointer stops. 
The sum of the spots is then announced, and the friends bet on the sector in which the pointer 
stopped. If the sum of the spots was 8, what are the odds for the various sectors. 
Die A has 4 red and 2 white faces and Die B has 2 red and 4 white faces. A coin is flipped once. 
It if falls heads, the game continues by throwing Die A, if it falls tails, Die B is to be used. 
Show that the probability of getting a red face at any throw is 1/2. If the first two throws 
resulted in red, what is the probability of a red face at the third throw ? If the red turns up at 
the first л throws, show that the probability is 2"(1 + 2^) that Die A is being used. 
From a packet containing 8 unused and 2 used blades, 5 are drawn at random and packed 
separately. From the second packet, a blade drawn randomly is found to be used. Find the 
prob. that it is the only used blade in the second packet. [Ans. 1/5] 
Suppose a “five warning light" comes-on during flight in an aircraft. From past experience, 
the pilot has the following information : 
(a) Probability that a fire will cause the warning light to come on = 0.95 
(b) Probability that warning light will come on when there is no fire = 0.01. 
(c) Probability that there will be a fire on any given mission = 0.001. 
Show that the chance that there is actually a fire when the warning light is on, is 95/1094. 


(a) Suppose that the reliability of chest X-ray test for the detection of T.B. is specified as 
follows : Of people with T.B., 90% of the X-ray tests detect the disease but 10% go undetected. 
Of people free of T.B. 99% of the X-rays are judged free of the disease, but 1% are diagnosed 
as showing T.B. from a large population of which only 0.1% have T.B. one person is selected 
at random, given a chest X-ray, and the radiologist reports the presence of T.B. What is the 
probability that the person has T.B. ? 
(b) Mr. X is Mete to have one of the diseases D,, D,, D, which are rampant in society in 
the ratio 2: 1 : 1. He is given a test which turns out to be positive in 25% of cases of D,, 50% 
of D, and am of D,. He is given these three tests and is declared positive in two. (event 7). 
Show that P(D, | T) = 18/69, P(D,| T) = 24/69 and P(D, | T) = 27/69. 
(a) A box contains n, + л, + n, tags where л, tags are numbered І, n, tags are numbered 2 and 
n4 tags are i ONT 3. There are three COH and they are numbered 1, 2, 3. Urn number j 
contains r, red balls and b; black balls. A tag is selected at random from the box, and then a 
ball is selected at ada from the urn of the same number as the tag selected. If the ball 
selected is red, show that the chance that it came from p number 2 is 

n5r,[(r, + p?) Уугуп! (ry + b pF 
(b) There are n, + n, +... + n, = N urns, Na first n, urns containing a, white, b, black balls 
each, the next " urns contain a, white b, black balls each, ..., and the last n, kis contains a, 
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white and b, black balls each. One urn is selected at random and a ball is drawn from it. If it 
is white find the prob. that the next ball drawn is also white, when (i) the first ball was 
replaced, (ii) the first ball is not replaced. 

There is a series of n urns. In the kth urn, there are k white and n — k black balls, 1 <k <n. One 
urn is chosen at random and 2 balls are drawn from it. Both turn out to be white. Show that the 
prob. that the ith urn was chosen, where 3 < i < n is given by i(i- 1) [ZK(k - D] , 1 Sj<n. 
Each of the n bags contains 4 red and 7 black chips while another bag contains 7 red and 4 
black chips. A bag is chosen at random from the (n + 1) bags and 2 chips are drawn out of it 
together and both are found to be black. If it is now calculated that the probability that there 
are 7 red and 2 black chips remaining in the chosen bag is 1/15, show that n = 4. 

A commuter residing in Dadar and working in Colaba must either return by Central Railway 
(C.R.) or Western Railway (W.R.) to get home. He varies his route, chosing the C.R. with 
probability 1/3 and W.R. with probability 2/3. If he goes by C.R. he gets home by 6 P.M. 75% 
of time. If he goes by WR. he gets home by 6 Р.М. only 70% of the time, but he likes the 
scenery better that way. If he gets home after 6 P.M. shows that the probability, that he used 
W.R. is 28/43. 

The probability P, that a family has k children is given by P, = (1 – 2py2** !, k22, Po=P, =p. 
It is known that the family has 2 boys. Show that P (Family has only 2 children] — 27/64, P 
(Family has 2 girls as well} = 81/512. | 

A man is equally likely to choose any one of the three routes A, B, C from his house to the 
Railway station and his choise is not influenced by the weather. If the weather is fair, the 
chances of missing the train by routes A, B, C are respectively 1/20, 2/20, 4/20. He sets out on 
a fair day and misses the train. Show that the probability that the route chosen was C is 4/7. 
On a rainy day, the respective probabilities of missing the train by routes A, B, C are 1/20, 1/5, 
1/2. On the average, one day in four is rainy. If he misses the train, what is the probability that 
the day was rainy ? 

Buses of four routes A, B, C, D call at a certain bus-stop and out of every 14 buses, it can be 
assumed that 5 are A, 4 are B, 3 are C, and 2 are D. Two types of buses, old and new, are in 
service in equal numbers taking all 4 routes together, but the number of new buses on the 
different routes are such that if a person boards a new bus without noticing its routes indication, 
it is equally likely to be on any of the four routes. A person boards an old bus without 
noticing its route indication. Calculate the probability (a) from first principles, (b) by using 
Baye's theorem, that the bus is on route A. 

Three prisoners A, B, C are told that any two of them are to be released on parole. A warder 
friend of prisoner A knows who are to be released. Prisoner A thinks of asking the warder for 
the name of one prisoner other than himself, who are to be released. He argues to himself that 
before he asks, his chances of release are 2/3. After knowing that B (say) shall be released, his 
own chances will fall to 1/2, because either A & B or B & C are to be released. And so 
A decides not to reduce his chances by asking. Show that A is mistaken in his calculations. 


(a) A printing machine can print л letters say 0, 05, ..., Q, It is operated by electrical 
impulses, each letter being produced by a different impulse. Assume that p is the constant 
probability of printing the correct letter and the impulses are independent. One of the 7 
impulses chosen at random, was fed into the machine twice and both times the letter о was 
printed. Compute the probability that the impulse chosen was meant to print o. 

[Ans. P = (n – Dpy/[np? - 2p + 11] 
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§2-60. Miscellaneous Worked-out Problems Lr JV 
(b) Each packet contains N blades. Let P, denote the probability that a packet contains А 
defective blades (0 < k € m). A sample of n blades from a packet reveals r < т defective blades. 
Find the probability that the selected packet actually contains k(2 r) defective blades. 
If a packet is rejected whenever it contains d € r defective blades, what is the chance that the 
packet is rejected ? 

31. Assume that history goes back 2 million days. On each of these past days, the sum has risen. 
"What is the probability that the sun will rise (i) tomorrow, (ii) each day for the next 2 million 
days. 

32. A bag contains n balls, all possible proportions of white and black beir 
A ball is drawn from this bag and turns out to be white. This ball is repalced and then another 
ball is drawn, which also turns out to be white. If this ball is replaced, prove that the chance 


of getting a black ball in the next drawing is s(n —1)(2n+ D 


ng equally likely. 


33. Inn trials, r successes have been observed. Assuming that aprori P{ p = i/k) = I/k, | Si < k, find 


the probability that in the next n, trials, r, successes will occur on the assumption that aprori 
probability is uniformly distributed in (0, 1). Find also the limit as л — %. 
2-60. Miscellaneous Worked-out Problems 
Example 1. Show that | P(A) — P(B) | < P(A A В). 
Deduce : P(A A C) < Р(А А B) + Р(ВА C). 
Solution. We estimate the difference as under : 
P(A)- P(B) < P(A U B)- P(B) = [AC (AUB) 
-P(A-B) [Р(С- Рр) = Р(С) – Р(р), рс С] 
< РА – В) + Р(В-А) [х<х+у, х,у є R] 


=P (A A.B). 
Interchanging A and B gives P(B) — P(A) < P(A A B) 
Combining the two components : | P(A) — Р(В) |< P(A ^ B) 
Recall : А АВ = AB © AB. 


Deduction. We use triangle inequality : 
| P(A) - P(C) | <I P(A) - P(B) | + | P(B) - P(C) | 
> P(AAC) <P(AAB)+P(BAC). 
Note. Deduction trivially follows : 
(AAC) C(AAB) У (ВО С SPAA C) < Р(ААВ) + PB AC). 
Example 2. Ап urn contains п white апа т black balls, a second urn contains N white 


and M black balls. A ball is randomly transferred from the first to the second urn and 
then from the second urn to the first urn. If a ball is now selected randomly from the 


first urn, prove that the probability of its being white is, 
Жа mN — nM 
n*m (nem) (N-M«V) 
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a black ball by ‘bh’ and let wb represent a white 
and a black ball returned to the 
Пу exclusive and collectively 
ferred as wb, bw, bb, ww. So, 

Pall) 
anges ; then by Multi- 


Solution. Denote a white ball by ‘w’, 
ball taken from first urn and put into the second urn 
first urn, etc. We can now distinguish four mutua 
exhaustive events according to the colour of the balls trans 
P(wb) + P(bw) + P(bb) + P(ww) = 1 

Let W be the event of drawing a white ball from urn | after exch 
Stage rule : 

P{W) = P(W1 bw) P(bw) + PW | wb) P(wb) + P(W | bb) P(bb) + PCW 1 ww) P(ww) ...(2) 


n 


W 
Now P(Wibw) mea re R =—1—, РОУ a PW w) = 


m+n’ n+m m+n 
Substituting these values in (2), we get 
(m + n) P(W) = (n + 1) P(bw) + (n — 1) P(wb) + nP(bb) + nP(ww) 

= n[P(bw) + P(wb) + P(bb) + P(ww)] + P(bw) — P(wb) = n + P(bw) – P(wb) [by (1)] 3) 


Now, P(bw) = P(b)P(wlb)- DH. gees [black from I to II and white from II to I] 
m+n M+N+1 


n M 
P(wb) = P(w) RO= ета 
Substituting these values in (3), we get 
Аа MU I 
m+n (men (M+N+1) 
Example 3. A marks a slip of paper with a plus sign with probability 1/3 and marks a 
minus sign with probability 2/3. A passes the slip to B who may or may not alter the 
sign before passing it to C. Next C passes the slip to D after perhaps chaing the sign. 
Finally D passes the slip to a referee after perhaps changing the sign. The referee 
finds a plus sign on the slip. It is known that B, C, D each changing sign with 
probability p. Compute P{A originally wrote a plus sign}. 
Solution. Let, T = (A wrote a plus sign}, M = (A wrote a minus sign} 
К = (Referee found the plus sign on the slip} 
We shall use Multi-stage p-Rule : 
PIR} = P{T} P(RIT) + Р(М) Р(КІМ) | (1) 
P(RIT) = P{Plus sign was not changed U Changed exactly twice) 
P{plus sign not changed in 3 phases} + P(sign changed twice in 3 phases] 


(wr + (Sar = ad^ + 3p). 


P(sign changed once 0 sign changed thrice} 
P(sign changed once) + P(sign changed thrice) 


(Ja! p. Q^? = PBa + p’). 


[white from I to П and black from П to IJ 


РИ у= 


P(R | M) 


M 
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P(T) = 3, P(M) = 2. Substituting into (i) gives 


ас 
> 
T 


1409 + 3р?) + 2 p(3q° + р?) = Leq’ + 2p’ +6pq° + 3qp^) 


= 3[1+ p+ 3pq"], [(p 9) = 1] 


Р{ТІК) = P{R IT} P(T)/P(R) (Reversal Identity) 


= 409 + 3p^y(1 * p + 3pq’). 


Note. When p = 2/3, P{T | R} = 13/41. 


a 


д": 


4%. 


Problems with Solutions Provided at the End of the Text 


Two fair dice are thrown, the resulting outcomes being 

О = (а, Б) #1 <as6,1<b<K< 6}. Three events А, В, С are defined as : 

A = {(a, b) : a is odd}, i.e. odd face with first die. 

B = {(a, b) : b is odd}, i.e. odd face with second die. 

C= [(a, b) : a + b is odd}, i.e. sum of points on two dice is odd. 

Check whether A, B, C are independent or independent in. pairs only. 

An urn Contains two coins, one is honest and the other is 2-headed. A coin is 

selected at random and tossed. You are allowed to see the up-face which is heads. 

What is the chance that the hidden face is also heads ? 

A sportsman’s chance of shooting an animal at a distance r(> a) is a Ir. He fires 
when r = 2a, and if he misses, he reloads and fires when r = 3a,.4a,. л. If he 
misses at distance na, the animal escapes. Find the odds against the sportman. 

Equally competent players A, B, C play a game. At each round the player who 
wins scores one point. The game is own by the first person who scores a total of 
3 points. A wins the first round. Find the chance of B's winning. 


Miscellaneous Exercises 


(a) IFA N B= Ø, show that, min { P(A), P(B)} = 0. 

(b) If A and B are exhaustive and independent events, such that P(A) « 1, show that P(B) = 1. 
(c) If A, B, C are exhaustive and mutually independent events such that P(A) < 1, P(B) < 1, 
then P(C) = 1. Extend the result to four events. 

(d) Show that d(A, B) = P(A A B) satisfies the triangle inequality and | P(A) — P(B) | <d(A, B). 
(a) A proper event A is such that P(A) = 1. Prove that A is independent of every other event. 
(b) Show that if an event A is independent of two mutually exclusive events B and C, then it 
is also independent of the event BU C. 

(c) If A, B, C are mutually independent events, then A U B and C are also independent. 

(d) Show that if A, B, C are pairwise independent events and A is independent of B U C, then 
^, B, C are mutually indep. 

(a) Show that A and B are independent iff P(A 1B) = P(AI B) ғ 


(b) If A, B, С are three events such that P(C) = 0, and A and B are independent, show that A, B, 
C are independent. 
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(с) Events В and С are independent, P(B), P(C) > 0, then for any event A, 


P(A | B) = P(A | BC) P(C) + P(AIBC) P(C). 


Conversely, if this relation holds, P(A | BC) # P(A | B), and P(A) > 0, then B and C are 


independent. 

Consider the experiment of tossing two pair tetrahdra (with four faces numbered 1 through 4) 
and noting the numbers on the downturned faces. 

(a) Give three proper events which are independent. 


(b) Give three proper events which are only pairwise independent but not independent. 


(c) Give four proper events which are independent. [Event A is proper if 0 < P(A) < 1]. 


(a) Two dice (D, and D,) are thrown. Find the probability of throwing (i) double, (i1) sum 5 
or 9. If A is the set of events for which sum on the two dice is 11 and В is the set of events for 
which D, does not show 5, find P(A N В) and show that A and B are not independent. 

[Ans. 6A, 8A, A, A= 1/36] 


(b) A bag contains 5 white, 3 black and 4 red balls. A ball is drawn at random from the bag. 
Define the events B, W, R as follows : 
B : The ball drawn is black, W : The ball drawn is white, R : The ball drawn is red. Examine 
pairwise and mutual independence of events B, W, R. Are B, W, R mutually exclusive ? Find 
P(R), P(B U W), P(B U W). [Ans. 8/12, 8/12, 1] 
Urn A contains two white balls and two black balls ; urn B cntains three white and two black 
balls. One ball is transferred from A to B ; one ball is then drawn from B and it turns out to be 
white. Prove that the chance that the transferred ball was white is 4/7. 
A white ball is dropped into a box containing n balls. What is the probability of drawing the 
white ball from this box if all the hypotheses about the initial colour composition of the balls 
are equally likely. [Ans. p= (п + 2)/2(п + 1)] 
The probability that k calls are received at a telephone station during an interval of time 1 is 
equal to P (k). Assuming that the number of calls during two adjacent intervals are independent, 
find the probability P,,(s) that s calls will be received during an interval 2r. 

[Ans. p= UP (k) P(s—k),O<k<s] 
Each of k urns contains л identical balls, numbered 1 to л. One ball is drawn from each urn. 
Prove that P{ the greatest number drawn is m} = (m* -(m- Dn where 1 < m € n. 
The probability that a family has exactly k children is P, (ХР, = 1). For any family size, all sex 
distributions are equilikely. What is the probability that a family has only one child, if it is 
given that the family has no girls (boys) ? [Ans. 1/2р, PANAT A a 1 <k< o] 
Let you classify people by 3 economic classes ; Poor, Middle, Rich. Suppose you find 10% of 
the poor, 54% of the middle and 17% of the rich have colour television sets. Suppose further that 
the poor constitute 20%, the middle 75%, and the rich 5% of the population. A person selected at 
random is found to possess a colour T.V. set. How likely is he to be rich ? [Ans. p = 0.0197] 
Among п persons т(< n) prizes are distributed by random drawing in turn from a box containing 
n tickets. Are the chances of winning equal for all participants ? When is it best to draw a 
ticket ? [Ans. p = m/n; immaterial] 


Three ships A, B, C sail from England to India. Odds in favour of their arriving safely are 2:9, 
3 : 7. and 6 : 11 respectively. Show that the chance that they all arrive safely is 18/595. 


14. 


16. 


17. 


18. 


19 


20. 


21. 


22. 
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A, B, C each fire one shot at a target. The probabilities of their hitting the target are respectively 

given by 3/10, 1/4 and 1/10. If one bullet is found in the target, prove that the probability 

that it came from A's gun is 27/55. 

Two cards are drawn in succession from a deck of playing cards. Determine (i) uncoditional 

prob. that the second card is an ace (the first card drawn being unknown) and (ii) the conditional 

prob. that the second card is an ace, if the first draw was an ace. [Ans. 1/15, 1/17] 

A and B are two independent witnesses (i.e. there is no collusion between them) in a case. The 
probability that A will speak the truth is x and the probability that B will speak the truth IS y. 
A and B agree in a certain statement. Show that the probability that this statement is true, is 
ху/(1- y — x + 2xy). 

An urn contains a white and b black balls and a series of drawings of one ball at a time is 
made, the ball removed being returned to the urn immediately after the next draw is made. 
If P, = probability that nth ball drawn is black, show that P, = (b — P, – 1)/(a + b — 1). Hence 
find P,. 

The chance of success in each trial is p. If P, is the probability that there are even number of 
successes in К trials, prove that P, = p + (1 - 2p)P, |. 


Deduce : P, = 4[1 + (1- 2p]. 
If a day is dry, the conditional probability that the following day will also be dry is p. If a day 


is wet, the conditional probability that the following day will be dry is p'. If P, is the 
probability that the nth day will be dry, prove that P, — (p - p')P, ,—p' = 0, n > 2. If the first 


п- 1 
day is dry, and p= = , p' = T, find P,. 


(a) A single die is tossed, then л coins are tossed where n is the number shown on the die. Find 
the probability of exactly 2 heads. 

(b) A box contains 10 balls of which 5 are black. An integer л is chosen at random from the 
set S= (1, 2, 3, 4, 5, 6) and then a sample of size n is drawn without replacement from the box. 
Find the chance that all the balls in the sample are black. 

(a) A rook is palced on a specified square on a chess-board. At each move, it has an equal 
probability of moving to any one of the squares, other than the one currently occupied, in the 
same rank or file. Find the probability that it will return to (a) the original rank, (b) the 
original square at move number 7. 

(b) There are two lots of items. It is known that 9046 of the items of one lot satisfy technical 
standards and 20% of the items of the other lot are defective. Suppose that an item from a lot 
selected at random turns out to be good. Show that the probability that a second item of the 
same lot will be defective, if the first item is returned to the lot after it has been checked is 
5/34. 


(a) Four barrels designated A, B, C, D contain balls of three different colours : white, black 
and red in proportion shown below : 


Barrel у А В С D 

White > 05637 0.45 0.50 0.55 
Black DUI 0.35 0.35 0.25 
Red < 0.60 0.20 0.15 0.20 


A barrel is chosen by spinning a six faced die with letters А, В. С, D anda ball is drawn from 
it. Show that the prob. that it is white or black is 0.75. 
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(b) An amplifier may burn one or both of its fuses if one or both of its tubes are defectives. 
Define the events : Т. = only tube i is defective, i = 1, 2; T, = both tubes are defective F, = fuse 
jis burns out (j = 1, 2), F, = both fuses burn out. The various probabilities are as under : 
РЎ, | T) =0.7, P(F, | T,)=0.3, F(F, | T.) = 0.2, P(F, | Tj) z0., P(F, | Т.) ='().6, i | T.) = 0.02. 
P(F,1T,)=0.1, P(F,1T,) 20.1, P(F;!T;) = 0.6, P(T,) = 0.3, (T) = 0.2, PCTs) = 0-1. 
Evaluate P(T, | F;), P(T, | F4), P(T, | F, U F3). Ea 
In a three game hockey play-off between teams A and B, team A has 58% chance of panning 
the first game. Winning a game boosts morale of either team so that its chances of winning its 
next game are impoved by 5%. Show that the probability that the team A wins the series is 
0.61898. (Disregard ties). 
(a) Problem of four liars. One person ‘A’ out of four receives information In the form of a 
‘yes’ or ‘no’ and he transmits it to the second person ‘B’. The second person transmits it to the 
third person “С”, the third to the fourth ‘D’ and the fourth communicates the received 
information to the sender. Given the fact that only one person in three tells the truth, show 
that the probability that the first liar told the truth if the fourth told the truth is 13/4] 
(b) It is known that each of 4 people A, B, C, D tells the truth in a given case with probability 


: . Suppose that A makes a statement, and then D says that C says that B says that A was 


telling the truth. Prove that the probability that A was actually telling the truth is 13/41. 
In an election, candidate A received x votes and B receives y votes, with x » y. Assume the 
ballots are opened one by one, and all possible orders of votes (given the final results x and y) 
are equally likely. Show that, in the counting of votes. 

P{A always ahead of B] = (x — y)/(x + y). 

In the following figure (a) and (b) assume that the probability of a relay being closed is p and 
that a relay is open or closed is independently of any other. In each case find the probability 
that current flows from L to R. 


1 
1 2 — 
, ie BL : 
5 3 
> 4 KIX 3 
4 
H 
5 6 
(a) (b) 


[Ans. 2р? (14 p) - 5p! + 2p; p & 3p! - 4р - p! + Зр - p] 


If a man defrauds you one t?me, he is a rascal; 
if he does it twice, you are a fool. 


знн 


There is always room at the top for improvement. (Webster) 


Appendix : 
Geometrical Methods for 
Probability Numericals 


The application of geometry to problems of probability introduces in a natural way a 
broader concept of probability which goes beyond the elementary notion of the number 
of happenings of discrete events. Here, all points of interest lie within some prescribed 
region R. The probability measure is so defined that the total probability of the admissible 
region is unity, whereas that of all non-admissible region is zero. Since an uncountably 
infinite number of points lie in a finite region R of space S, the probability measure 
has to be defined in terms of the geometrical measure appropriate to the dimensionality 
(e.g. length, area, volume, etc). Thus, 

P{x e R} = Measure of region R)/(Measurc of region S) К c S. 
It is generally assumed that the probability measure of R is directly proportional to 
geometrical measure of R. Geometrical problems often require the use of integration. 
The following problems illustrate the principles involved. 
Example A-1. Two points are selected in a line AB of length a so as to lie on opposite 
sides of its middle point C. Find the probability that the distance between them is less 
than a/3. 
Solution. Choose points P and Q on the segments CB and CA and let CP = x, CP = y, 
so that the random choice provides 0 x x < a/2, 0 < y < a/2. We are interested in the 
event x + y € a/3. Draw the square OLMN of side length a/2 and its sub-region triangle 
ORT, with OR = OT = a/3. The required probability is 


p = 10969/t9(9-1. 
1 Boom meon з 


Ex. A-1 


Example A-2. Two points are chosen independently and at random from the interval 
[0, 1]. What is the chance that the two numbers differ by more than 1/2 ? 


ence. Baye’s Reversal Rule 


X and Y. Then their ranges are 0: x. 
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Solution. Let the numbers chosen be denoted by 
< 1. We need find p = P{ 1X - ҮүІ> 1}. This corresponds to the sum of two shaded 


areas of the unit square, obviously, p = i. 

Example A-3. The outcomes of an experiment are represented by points in the Square 
bounded by x = 0, у = 0, x.= 2, y = 2 in the xy plane. If the probability is distributed 
unformly, determine the probability that x + y. > 4. А 
Solution. We exhibit the sample space square of side 20 and the region х + y > 4, 
shown by light shade. The measure (area) of the shaded region is 4 — 7, hence the 
required probability measure P(3? + y > 4} is p = [4 - 71/4 = 1 — (7/4). [See Figure] 


Note. Р{х2 + у? > ips еро? «y 0=1-1(1)=1- 16: 


о 
Ех. А-3. Ех. А-4. 


Example А-4. A circular target is divided into three zones bounded by concentric 
circles of radii 1, +, 1 respectively. If three shots are fired at random at the target, 


what is the probability that exactly one shot lands in each zone ? 
Solution. The measure of sample space [area of circle of unit radius] is n(1) i.e. T. 
Hence, the probab. of a shot falling in the region of radius a(a « 1) is p = xa CETE 


Thus, the probability of a shot falling in region A(a = PE is p, = 1, probability of a shot 


falling in region B is р = (2) = (1) = = and the probability of a shot falling in region 


Cisp, = 1-6 y= i. The shots fall in the three zones independents of each other. 


Hence by Product йй, the probability of one arrangement, say first shot in A, second 
shot in B and third shot in C) is p, p; p, = 5/432. Since there are 3 ! = 6 possible disjoint 
arrangements, the required probability is 6 x 5/432 = 5/72. 


Example A-5. The sum of two positive quantities is equal to 2n. Find the chance thal 


the product of the two quantities is not less than 1 times their greatest product. 


Solution. Let x > 0, y > 0 be the given quantities so that x + y = 2n. To find the greatest 
value of xy, we notice that z = xy = x(2n — x) = 2nx — x, 2’ = -2n — 2x, z" = -2 < 0. 
Now z' = 0 > x = п and hence y = n as x + Y = 2n. 
Thus, the greatest value of xy is n’. Now, we want, 

р = P{xy € (Зп 2/4)} = Р{ху > Зп 7/4} (Put y = 2n A) 
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2 JE ntum ttum 
= Р{4х чә 8пх + Зп < 0] — P((2x zii 3n) (2x ” п) е 0} - P[n/2 з X s 3n/2). 


Since 0 < x < 2n, (variation of x), total range of x values is 2n. 


The favourable range is (3n/2) — (n/2). It follows that, p = (n/2n) = +. 
Example A-6. AOB is a fixed diameter of a circle of radius a. A point is chosen at 
random within the circle. Find the chance that the point is within an inscribed isosceles 
triangle with AOB as one of the three sides. 

Solution. If ABC is an isoscles triange (AB=2a, AC = BC =avV2) its area is A = а 
There are two such triangles (two opposite sides of АОВ), hence р = 2а?/та* = 2/n. 


Ex. A-6. Ex. A-7. 
Example A-7. Three points are taken at random on the circumference of a circle. Find 
the chance that they lie on the same semi-circle. 
Solution. Let the length of the circumference of the given circle be 2a. Fix a point A, 
let AB = x, AC = y, where we measure arc in the clockwise sense. The sampel space О 


is obviously. 


ee (xs 0 Еб 20,7 2 0 < y 2a}, 
Let E c Q denote the set consisting of those points for which the points A, B, C lie on 
the same semi-circle. Then 
Е -{х<а, у<а} U (x»a, у>а} U (x «a y-x»a] tt (y«a,x-y»a) 
Notice that x < a then AB’ = x + a, C' exceeds AB’ so that y > x + a. 
The measure favourable to E is shown on the indicated diagram. 


_ Measure of E _ За? 
~ Measure of О д? 


Example A-8. If (n + 1) particles Aj, Ay, «+ An +1 
OA (length a), each has the same chance of finding itself the (k 
reckoned from О to A. Also, since someone of them must occupy 
that chance is 1/(1 + n). Examine this rigorously. 


"E 
г 


be thrown at random upon a st. line 
+ 1)th position in order 
the (k + 1)th position, 
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Solution. The composite chance that a point A, € [x, x + dx] and k unspecified points 
(particles) fall in [O, OA,] and rest (n — X) fall in [OA,, OA] is 

k 0 A, ^ 
КИИ 
k a a nn A al 

X dx Mu. 

If B denotes the event that A, occupies the (k + 1)th place, irrespective of where it lies 
on OA, then 


n 
k 
К! (п-к)! 2Г(п + 2) "5-1 
Note. Put x — at in (1), use beta integral for alternate evaluation. 
Example A-9. Two numbers are selected independently at random in the interval [0, 1]. 


P(B) 


n-k Р 5 
fix e[i-z) dr rd п "(сох)" sin 0)2** do (Pu = -sin'o IAES 
a B 0 


If the smaller one is less than 1, prove that the chance that the larger one is greater 


than 2 i 


Solution. Here S = {(x, y) : 0 < x, y < 1}; so that geometric configuration is a unit 
square. Let М = sup (x, у) and т = inf (x, y). We need find 


psP(M2iílms Ij2P(M22.msj JP(ms 1). 
Now P{m< +} = Shaded area L Ө М=1+1-1=3. 
Р{М > 2, т < Mt = Shaded areas A and В = 2x 1.1-1. 
p-G/9- 
Example A-10. A m segment AB is divided by a point C into two parts : AC = 4, 


CB = b. Two points X and Y are taken at random on AC and CB respectively. What 15 
the probability that AX, XY, BY can form a triangle. 


Exercise 1 03 
Solution. Let AX = x, BY = y, so that XY = a + b — (x + y). The points x and y have 
uniform distribution in the intervals [0, a] and [0, b]. Now a triangle is possible iff the 
sum of its two sides is greater than the third side. This fact supplies the conditions : 
х+у>а+р- (х+у); x+[at+b-(x+y)]>y; у+[а+Ь-(х+у)] > х 
That is, х + y » (а + Б)/2, x < (а + by2, y < (а + by2 


1 Р 
х+у= (à +b) 


We interpret geometrically these inequalities. The total region is the rectangle OLMN. 
The favourable region, governed by three inequalities, is the triangle PST, but only 
the triangular region PQR lies in the admissible region (sample space). Hence, the 
required probability p is 


p = measure of APQR/Measure of rect. OLMN = (4b°)/ ab = b/ 2a. 


Exercises for Geometrical Methods 


1. Two points P and Q are taken at random on a given st. line OA of length a. Find the chance 
that the distance betwen them is (i) greater than a length b < a, (ii) less than a length b(a), 
(iii) Find the probability that the point P is closer to Q than to O. 


[Ans. p, = [1- (b/a), p; 2 1- p, p,7 1] 

2. Two points are selected at random on a given line of length a. Show that the chance that none 
of the three sections into which the line is thus dived is less than a/4 is 1/32. 

3. The sides of a recntangle are taken at random each less than a and all lengths are equally 
likely. Show that the chance that the diagonal is less than a is 7/4. 

4. In each of two adjacent sides of a square of side a, a point is taken at random. Show that the 
chance that the length of the line joining the two points is between a/2 and a is 31/4. 

5. A point is taken at random within an ellipse (х2/а?) + Gp?) = 1. Show that the chance that its 
distance from the centre exceeds b is | — (b/a). 

6. A point is selected at random inside a circle. Prove that the chance that the point is closer to 


the centre of the circle than to its circumference is 1 г 


7. Find the chance that a random triangle inscibed in a circle is (i) acute angled, (ii) obtuse 


3 = 
angled, (iii) right-angled. [Ans. p, = 1 „= 35 P370] 
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10. 


11. 


13. 


14. 


15, 


16. 


Ly 


18. 


19. 


A chord is drawn at random in a given circle. What is the probability that itis greater th in the 
' ‘ , T P | 
side of an equilateral triangle inscribed in that circle ? (Ans. + and =, both possible] 


^ rod of length a is broken into three parts at random. Show that the probability that the three 


parts can form a triangle is 5 
Bertrand Problem. A chord is drawn at random іп а circle. Show that the chance that its length 


is not less than the radius of the circle, if it is assumed that all distances of the chord from the 
centre of the circle are equally likely, is /3/2. 

A point is picked at random in a square. Show that the chance that it is lies inside the 
inscribed circle which is concentric with the square is 7/4. 

AB is a fixed diameter of a circle of radius a. A point is chosen at random within the circle. 
Show that the probability that the point is within an inscribed isoscles triangle with AB as 
one of the three sides is 2/n. 

A phonograph record 7" in diameter is thrown on the tiled floor of a game room. If the tiles 
are 10" square, shown that the chance that the record will lie wholy on one tile is 0.09. 

A square sheet of tin, 20 centimetres wide, that contains 10 rows and 10 columns of circular 
holes, each | centimetre in diameter, with centres evenly spaced, at a distance of 2 centimetres 
apart. What is the chance that (i) a particle of sand (considered as a point) blown against the 
tin sheet will fall upon one of the holes and thus pass through it, (ii) a ball of diameter 0.5 cm 
thrown upon the sheet will pass through without hitting the tin sheet? — [Ans. 7/16, 7/64] 


Show that the chance that the sum of two randomly chosen positive numbers, both < 1, will 
not exceed 1, and their product will be < 2/9 is (1/3) + (2/9) (п 2. 


Buffon's needle Problem. A board is ruled with equidistant parallel lines, the width of strip 
between two consecutive parallel lines being d. A thin needle of length / « d is thrown on the 
board. Show that the chance that the needle will intersect one of the lines is //ma. What 
happens if / » 4? 

Laplace Problem. A board is covered with a set of congruent rectangales of dimensions a, 5 
and a thin needle of length /(/ < a, | < Б) is thrown on the board. Show that the chance that the 
needle will intersect a boundary of the rectangles is [2(a + b)l — 12]/nab. 

A floor is paved with tiles, each tile being a parallelogram such that the distance between 
pairs of opposite sides are a and P respectively, the length of the diagonal being /. A stick of 
length c falls on the floor parallel to the diagonal. Show that the probability that it will lie 
entirely on опе tile is[1— (c/I)].. If a circle of diameter d is thrown on the floor, show that the 
probability that it will lie on one tile is [1 — (d/c)] [1 — (d/b)]. 

A bus of line A arrives at a station every 4 minutes and a bus of line B every 6 minutes. The 
length of an interval between the arrival of a bus of line A and a bus of line B may be any 
number of minutes from 0 to 4, all equally likely. Show that (a) P{ The first bus that arrives 


belongs to line A} = 2, (b) P{A bus of any line arrives within 2 minutes} = 4. 


Teachers open the door. You enter by yourself. (Chinese Saying) 
seieielereieieleleleleieleieieieleleleleleieleleieieieieieiieieiei 


Genius may have its limitations, but stupidity is not thus handicapped. 
(Elbert Hubbard) 


Appendix: 
Sequences of Events 


1. A sequence (A, : n > 1) is said to be an Increasing (Expanding) sequence of events if 
ИЕ Anc..CA CA ic... 


Here we define a new event A, by A, = lim A, = JA. 


no З 
i=] 


2. A sequence (A, : n > 1) is said to be a Decreasing (Contracting) sequence of events if 
dud, A eA a А үэ... 


Here we define a new event A, by A, = lim A, =()A,. 


n> З 
ixl 


Increasing sequence of events Decreasing sequence of events 
3. For апу sequence of events. (A, : n = 1}, we define the new events A* and A* as under : 


A* = lim sup A, = N UA; ={A,,i.0}, i:o. = infinitely of ten 
T1 i=li=n 
A, = lim inf A, = ПА ={A,, ult} ult = ultimately 


n= n=] i=n 


A* is called limit superior and A, is called the limit inferior of the sequence (A,) of 
events. 

Note. {A,, f.o.) = (A, i.o.}°, [f.o. = finitely often] 

Remarks. A point œ € A* if, for all n, o € AU A, iz n, п + l, ... о. This means o € A,, 
n= 1, 2, ..., оо. In other words, A* consists of all points that are contained in an infinite 
number of the events A, Р, 

A point o є A, if for some n, œ є (A, i 2 n, n + 1.:... ©. That is, if for some n, o € A; 
for all i} n. In other words, A, consists of all points that are contained in all except a 
finitte number of the events A; i > 1. The event A, occurs if all but a finite number of 
the A; occur (the finite number of exceptions, indeed, varies with the elements of О, 
Le. its value is random. The event A* occurs iff infinitely many of the A, occur. This 
reveals the strong requirement for the existence of lim A,. 

4. If for any sequence of events P{A, . n > 1), A* = A,, then we say that lim A, exists 
and define : 
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lim A, = = lim sup A, = limifif А,. 


5. For a Real Sequence we define the numbers : 
lim sup (а,) =inf (sup(a, a,,,,.) :n2 1, 2, 3, JA] 
lim inf (а) = sup (inf {a,, a, ,,,-.}: n= 1, 2, 3, a: 
Observe that : lim inf (a,) < lim sup (a,). 
Example (i) (lim inf A,)' = lim sup A’... (ii) lim sup (A, U B,) = (lim sup A,) U (lim sup В). 


B-1. Continuity of Monotone Probability Function 
If (A, : n > 1) is either an increasing or decreasing sequence of events, whose limit is 
A, then 

lim P(A,) = P(lim A,) = P(A). 
Proof. By d monotonicity of probability, lim P(A,) always exists. We now find this 
limit. 


(1) Firstly, we consider the case of expanding (increasing) sequence E; = E; + 1, where 
by definition, 


= lim E= UE, OA 


n>% =] 


We convert this non-disjoint bu into a disjoint union as under. Let 


E 


B, = Е, B, = (E, - Е) = EE, B, = EE, .. B,-(E.-E, у= Е 


Here each B, is a part of E, not contained in any previous sets in the sequence. This 
B, are disjoint sets and possess the obvious properties : 


n E, 


E, = ÜE,- ÜB, n2 1; UE, = lim Bem Es (2) 


Now, we use axioms of finite and infinite o-additivity : 


PE, у= РСВ, у= XP(B) - ШР )|- lim PUB, )= lim P(£, . 


zl j71 


Using (1), this amount to : 


P(lim E,) = lim P(E,). eve 3) 
noo n>% 
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~. 
li 


From i = (бв) we get "hr. = lim P(E,) 


[= n>% 


By nogation Rule, 1- 1096 lim [1— P(E,)] > A | = lim P(E, ) 
noo iz] n>% 


i=l 


Note. We can also establish (ii) without using (i). See Example B-3. 


B-2. Continuity of General Probability Function 
If (A, : 1 < n < со) is any sequence of events, then 


Р(А*) < lim inf P(A,)< lim sup P(A,) < P(A*). "i 
If lim A, exists, then P(lim A,) = lim P(A,) Rips 


Proof. Note that for increasing and decreasing sets of events, E, C E, , |, D, , C De 
To simplify writing, we set 
E, = ПА, D, = ЈА. 2i) 
i=n i=l 


Thus, (E,) is an increasing sequence, and (D,] is a decreasing (contracting) sequence 
of events. 
Hence, by continuity of monotone probability function 


P(A,) = lim P(E,) - sup P(E,) ...(ii)  P(A*) = lim P(D,) = sup P(D,) (iii) 
From (i), A; DENA тып: A; CD, Vj zñ, hence 

P(E) < P(A) => P(E) < inf P(A), j &n ...(iv) 

P(D,) 2 P(A) > P(D,,) 2 sup P(A), j 2 п (v) 


From (ii) and (iv) as well as (iii) and (v), we obtain, 
P(A,) < sup inf P(A;) = lim inf P(A,), Р(А*) 2 inf supP(A;) = lim sup P(A,) — ..(vi) 
m Jen А n " jen n 
Since, lim inf (a,) € lim sup (a,), we get from (vi) the result (1). 
If lim A, exists (A* — A,), then P(lim A,) = lim P(A,) . 


This is obvious, because the limit of a monotone class of events always exists. 
Remarks. Continuity of probability measure shows that finite additivity yields c-addivity. 
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B-3. First Borel-Cantelli Lemma 

Let A,, А,, ... be events (not necessarily independent) in a given probability space and 
let P(A) = Р,. If EP, (1 Si «€ со) is convergent, then P(A*) = 0. 


Proof. Observe that : A* = lim sup A, = (| UA,. For any n, since A*C UA,, we have 
n 


nal kzn kzn 


os Pus (OA | YP(A)- ЎР, NT 


k=n 
where we have used Monotone law and Boole’s inequality to get (1). Now, since УР. 
is convergent to p (say), we have 
р шш УР = im[»-Xn]-o- lim » P. 
n jz] no [= n9 (= 


Hence, the last member of Eq. (1) tends to zero as л — oo. It follows by squeeze rule 
that, P(A*) = 0. 


B-4. Second Borel-Cantelli Lemma 
Let A,, A,, ... be events which are mutually independent, and let Р(А,) = P;. If XP, 
(1 € i «€ оо) is unbounded (divergent), then P(A*) = 1. 
Proof. Observe that since (A*) = f) UA,, hence: (A*)' = UN dnm UB, (say), 
п=1 k=n n=lk=n n-l 


with obvious notation. Now 


n=] 


os Paty 1= 0в, рв, . [by Boole’s inequality] ...(2) 


Since the events A; are mutually independent, so are Bee and hence 


PB) = ПР(А)= A- P = ПО, [Q, - 1 - P) 


i=n 


To obtain a bound on this, we notice that 1 -x < e™, 0 <х<1 = О, <ехр (-P), (x= P). 


N N 
Thus: ПО, < exp (-En wher N>n. 


ian i=n 


N op 
As N — oo, УР ү эр[-$л, |> => ПО, =0. 
Thus, P(B,) = 0, and Eq. (2) provides that P[(A*)"] = 0. Whence P(A*) = 1 by complement 
rule. 
Cor. Kolmogorov Zero-one Law 
For independent sequence of events (A,), if an event is, in its tail field, then 


P(A*) = 0, if EP, < o» and P(A*) = 1 if E Р, = oo. 
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Thus, P(A,; occur infinitely often} = 0, or 1. No other value is possible. 
This explains why the term zero-one law is often used for Borel-Cantelli lemmas. 
Note. When >Р, < oo, then P(A, occur finitely often} = 1. 


B-5. Illustrations for Sequences of Events 

Example B-1. State precisely a set of axioms of probability and deduce the classical 
rule for the calculaton of probabilities. 

Solution. For aximons, see Art. 1-51, p. 21. 


Let О = (01, @,, ...} be a finite or countably infinite set. Let f be a real-valued function 
defined on О that satisfies 


Хо) 2 0, V o € OQ and X, Ќо) = 1. wit) 
Then, we can define a function P on the class F of all subsets of Q by letting 
P(A) =L flo), VACQ me 


We have P(A) > 0 and P(A) < P(Q) for every A, since До) > 0, V o and P(Q) = 1 [by (1)] 
Further if A ^^ B = Ø, then 


P(AU В) = E fG - X f(0)* (о) = P(A) + РОВ). 


Thus, axioms Р, (and similarly P.) is satisfied. It follows that P is a probability function 
апа (Q, F, P) is a probability space. 

Taking A = {@} as singleton, in (2) yields P({}) = Ko) for o є Q. Thus, f(@) gives the 
probability that the experimental outcome is о. 


Note. If О is finite, and if Ко) = 1/1 О | for all o є Q, then (2) yields P(A) 21A Л О | for 
A c Q, which is the classical formula for evaluating the probabilities. 


Example B-2. Show that the o-additivity follows from the continuity of probabilty 
function, i.e. continuity of probability is equivalent to c-additivity. 


Solution. Let the probability function P defined on F be continuous. Consider a sequence 
of m.e. events A,, A,, ... and define 


k=n+1 


A = UA, -(a. Jf Ga Jz, UD, E, = UA. р, E UA, t 1 


Obviously, (E,] is an increasing sequence of events with lim E, =A апа (D,] isa 
decreasing sequence of events with lim D, = Ø (since A; are disjoint). Since P is 
àssumed to be continuous, 


lim P (D,) = P(lim D,) = Р(@) = 0. (n > oo) (2) 
Using finite additivity of P-measure, we get from (1) 
P(A) = Р(Е,) + P(D,) = УР(А,) + P(D,) 
k=] 


AS n — о, the above, in virtue of (2), reduces to 


Ga J- LP. (o-additivity axiom) 
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Example B-3. If (D. : 1 <n < o] is a decreasing sequence of events whose limit is the 
"n p 

event D, then prove that lim P(D,) = P(D), as n 9. EE S inde 

Solution. This theorem is already proved in Art. B-1. The following EL Eom 

proof. When the D, are non-increasing, we want to E D se: 


If D= Пр, lim (D,) = P(D). Decompose D, into the unions of disjoint events as follows : 
п=1 n—»o0 


D, - (Оор, JuD: (2) 
j=n 


Observe that, 
D, 1, =O(n<j<o), 


DD;D,,, =Ø, 1< j <, because D = ^D (1 < n < o); hence D ы D;D;, 


Now by o-additivity of P, (2) gives 
P(D,) = ХР”, D; , D + P(D) (j2nto o) 163) 


From U D,D,,, с О (j = 1 to ©), we get ZP(D;D;,,) < 1, so 


j*1 


LADO) + X PO; D,,,)<1. 

i= j=n о Y 

lim У P(D, D.) + lim X P(D;D,,,) <1, > lim YP(D,D;,,) - 0. (4) 
N>O jz] NO д to ушп ; 


Using (4) into (3) provides (1). 
Example B-4. Suppose {E,, n 2 1} and {Н n 2 T are increasing sequences of events 
having limits E and H. Prove that if E, is indep. of H, V n, then E is indep. of H. 
Solution. Let G, = E, O H, – E, H,. Since E, and Н, are monotone increasing, so С, is 
also monotone increasing. Since probability function is continuous, hence 

lim P(E,H,) = P(lim E, lim Н, } = P(E Н). 
Example B-5. For sequences (A,) and (B,) of events on some sample space $, let 
lim P(B,) - 1. Show that lim(P(A,1B,) - P(A,)} = 0. Deduce that if lim P(A,1B,)< or 


ous no 
lim P(A,) < ©, both limits exist and lim P(A,1B,)= lim P(A, ). 
эче no n=% n 


Solution. Since lim P(B,)=1,lim[1~ Р(В,)]= 0. Further, P(A, U B,) > P(B, ) yields; lim 
P(A, О В,) = 1. 
Now P(A,|B,)- PA) e = pq, ABO ANB) _ PA) + PII) PA, B.) - IA) NB 
P(B,) P(B,) P(B,) 
lim (P(A,1B,) - РСА,)) = lim XA) D 7 P(8,)) + Р(В,) - РОА, ОВ) 041-1 n 
n—>oo lim P(B,) Eno = 0). ...( 


From elementary calculus of real sequences, if C, = d, — b, possesses a limit, then so 
do «a,» and «b,» iff at least one of these does possess a limit. Consequently, if either 
lim P(A, | B,) < о or іт P(A,) < œ, then both do possess finite limits and by (1). 

lim P(A, | B,) = lim P(A,), (n — oo). 


Results without causes are much more impressive. (Sherlock Holmes) 
[The Stock-Brokers Clerk] 


Heiane 


He talks at random. Sure the main is mad. (Shakespeare : Henry VI) 


One-Variate 
Distribution Theory 


3-10. Random Variables 


In random experiments, we are interested in the numerical outcomes (i.e. numbers 
associated with the outcomes) of the experiment. For example, we ask for the sum of 
the points on the pips when a pair of dice is thrown. When 50 coins are tossed, we ask 
for the number of heads and so on. Whenever we associate a real number with each 
outcome of a trial, we are dealing with a function whose range is the set of real 
numbers we ask for. Such a function is called a random variable (r.v.) chance variable, 
Stochastic variable or simply a variate. We shall consider only real-valued random 


variables in this book. 


y x(w) 

Definition 1. Let S be a denumerable set (i.e. finite or countably infinite). A discrete 
random variable X on a probability space (Q, F, P) is a real-valued function X mapping 
domain О into range 5 = (x,, X2, ..., X,, ...] of the real numbers R such that (o : X(@) = x,} 
€ F, for all i. 

The requirement : [o : Х(о) = x;) € F allows us to define р(х) = P(X = x). The collection 
{p(x) : x € S} is called the distribution of X and it satisfies the obvious : 


0xp(x)xl 2XpGQ)-l 
n a> es. 


Note. Discreteness also implies that F contains all subsets of Q, in particular, subsets 
of the form [o : X(o) < x}. 
Definition 2. A random variable X on a probability space, (Q, F, P) is a real-valued 


Junction X defined on О, such that for — < x < ©, {œ : X(w) < x} є F. Thus X:Q—R 


E. serpente we shall en write X = t for X(o) = t and (X < x} for 
Remark. The definition of a random variable does not require the notion of Probability 
Function. Thus, if X is a r.v. on (Q, F, P) and the probability measure is changed, then 
X is still a r.v. It should also be clear from the above definition that every real- valued 
function need not be a random variable (vide Example 1). Whether a given real- 
valued function is a random variable or not, depends on the underlying o-field. 


К 
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Illustrations (a) Toss of a single coin : Q = {һ, t). Let X be the r.v. defined by 


X(h) = 1, X(t) 20; i.e X = 1, if head occurs ; X = 0, if tail occurs 

(b) Roll of a single die : Q = (1, 2, 3, 4, 5, 6). Let X(@) = ©, © = 1, 2, 

variate X denotes the value of the upturned face. 

(c) Two distinct dice are rolled : Q = ((a, b) : a, Б = 1, 
X(a, b) =а + Б, 1 <а, b < 6. 

Тһе r.v. X denotes the sum of two numbers upturned when two dice are thrown. 


a 6 ; Le. the 


Devinn 0}. ТАМ 


3-11. Random Variable Versus Real-valued Function 

If Q is a sample space of a random experiment and if F is the o-field of all subs.ts of 
Q, then every real-valued function X on Q is a random variable. 

Proof. Let X : О — R be any real-valued function. For any real number x, the set 
[0 : X(@) € x} is a subset of О. Since F contains all subsets of Q, so {0 : X(@) € x] e 7, 
for all x e R. Hence X is a random variable. 

Remarks. In the case of discrete sample spaces, the underlying o-field will be taken 
as the set consisting of all subsets of sample space (i.e. Power Set). In the case of 
sample spaces which contain uncountably many points (e.g. А) the o-field F is generally 
taken as the smallest o-field containing all the semi-closed intervals of the form 1а, b I. 
This smallest o-field containing the intervals of the form ] a, b ] is known as Borel 
c-field. 

Example 1. Give an example of a variable which is not a r.v. 

Solution. Let О = (a, b, c, d) be a sample space with associated o-field F = {Ø, {a}, 
(5, c, d), Q}. Define X : О > R by X(a) = 0 = X(b), X(c) = X(d) = 2. 

X is a real-valued function on О. Now consider the set (o : X(@) € 1} = (a, b} e F. 
By definition of a random variable, x is not a random variable. 

Example 2. Let €) (sample space) be the set of all real numbers i.e. O = R. Suppose 
that F (A : A is countable or A is countable}, is the c-field associated with О. 

(a) Let X : Q > R be defined by X(@) = о, for all о є О. Then X is not a random 
variable. 

(b) Let Y : О > R be defined by Y(o) = 1, if о is irrational ; Y(@) = 0, if о is rational. 
Then, Y is a random variable. 

(c) Let 7: О > R be defined Ьу: Z(@) = 0, if o is rational. 

Z(w) = —1, if o is a negative irrational ; Z(@) = 0, if о is a positive irrational, then, Z is 
not a random variable. 

Solution. (a) By definition, X : Q — А is such that X(@) = o V @ є О = R. Consider the 
set А = (o: X(@) € 1} =], 1]. Then A =11, о. Since both A and A are uncountable, 
the function X is not a random variable 

(b) Let Q denote the set of all rational numbers. Since Q is countable, Q € F. Let y be 
the real number and consider the set A = (o : Y(o) € y]. 

If y «0, А = бе F;ifüsy« 1, А= Оє У; апііќуг2 1, А = О є 7. 

If follows that У is a random variable. 
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(с) For the function Z, consider the set A = (c : Z(o) < -+ }. 

By definition of Z, A is the set of all negative irrational numbers. A is not countable 
and its complement A is also not countable, because A consists of rational and positive 
irrationals and is thus uncountable. So A ¢ F and therefore, Z is not a random variable. 


Remark. Since UZ V= Y and Y is a random variable, so | Z | is a random variable 
although Z is not a random variable. 


Note. It is easy to check that 7 is a o-field. 


Constant R.V. Theorem | 

Let {О, F, P} be an arbitrary probability space. Let c є R be any real number. Then, 
the constant function X : О — К, defined by X(o) = c, V о є О is a random variable. 
Proof. Let X : О  R be defined by X(m) = c, Уо є Q. If x e Ris any real number, then 
A={@: X(@) Sx) = {0 : c <x}. If x< c, then d= Q e F;ifx2c,A2Qe 7. 

Thus, X is a random variable. 


Degenerate Variate. Let (Q, F, P) be an arbitrary probability space. A constant function 
X defined by X(@) = c, V o € Q, is called a Degenerate random variable. 


3-12. Indicator Random Variable and its Properties 
Let (Q, F, P) be an arbitrary probability space and let A be any event. Then, the 
function X defined by X(@) = 1, if œ € A; Х(о) = 0, if œ £ A is known as the indicator of 
A, and is written as /,. Thus 

I, = 1, if A occurs ; Г, = 0, if A fails to occur. 


To show that /, is a random variable : 

meo ОЮ <4} = бе F. 

ООС 7 (@) <x) = Ave F. If x2 1,(o id,(@) <x} =O e Л. 

If follows that /, is a random variable. 

Obviously, P(/, = 1) = P(o : 14(@) = 1} = P(A) , P, = 0) = P(A) = 1- P(A). 

If A,, A,, ..., A, are any events ; then X = 14 +14, +... +14, (o € О) 
counts the number of А), A), ...., A, which occur. 

If A,, 1 < k € n are disjoint and exclusive (i.e. form a Partition) the X = X,7, yields the 
index of that А, which occurs. 

Obviously, this sum provides (X = k} = {/4, =I}. 

Definition. Simple Random Variable. A quantity X is called a simple r.v. of it can be 


expressed as a linear combination of a finite collection of indicators, i.e. if there exist 
such that X = Ха; ГА, 1<і<п. 


events A,, ..., A and scalars а}, ..., а, 
This representation may not be unique. 
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Some Properties of Indicator Random Variables 


l. Ig=1, 1520. 2. dI, АД; BN pe D, de. 
UELLE 1 «Le reor for Dacos laua z (7/9. 7 18). 
Proofs. 1. 1,(@) = 1, because all points o є Q. I;(&) = 0, because no points о є 2 


2. 1-/,=1, iff o e A. 

3. ж" 1, iff o € Ap і.е. iff /„(®) = 1, 1300) = 1, i.e. iff 1,(@) 1500) = 1. 

4. lay p(9) = 1, iff o є (A U B), ie. о is in at least one of the sets A and B. In 
(1B I =@ х= / 

particular, if о € A, then 1 – 7, = 0, and the R. H.S. of (4) is 1. If o € A JT, ` 

and the R.H.S. of (4) is zero. 


5. dayey = lag 71a lg 2 (01-1) (0. 15), [by (2) and (3)] 
Note. If A and B are disjoint, Гав = Ig = 0, and then I, uB” I, 3 Ір: 
Extension to л events in all cases is immediate. Thus /4 ул, = 74, + 4, +... etc. 


Remark. The indicator random variable is often called the alternative variate ог zero- 

one variate or Bernoulli variate. 

Example 1. Let I, and 1, be the indicator functions of the independent events A and В. 

If the random variable X defined by X = 7, + /, satisfies the relations 
P(X22)2a,P(Xz21)zb,P(X20)-c 


show that at least one of the numbers a, b, c is at least B 


Solution. Let P(A) = p, P(B) =p’, O« p, р < 1, write g = 1 — p, 4 = 1 — p', and consider 
the quadratic polynomial P(x) given by 


Р(х) = (px + q) (px + 4) = pp'x + x(pq' + p'g) + qq. (1) 
Since A and B are independent, the given relations yield 
a = pp' #0, b -pq'tpq*0, c=qq'#0, (a+b+c=1) 
Note that, e.g. X = 1 > Г, = 1, І. = Оог/, = 0, I, = 1, and so on, 
Р(х) = ax + bx + c. лер: Б> 0, с> 0. 
амаз that x = –9/р and x = —4'/р' yields Р(х) = [by (1)] 
So Р(х) = 0 has real roots, its discriminant must be i sol i.e. b^ — Дас > 0. Hence 
a> 0, bed, 620, а+Ь+с= 1, ас< 24. ...(2) 


Now, suppose that a < $, b < 4, then ac < b7/4 < i. 


a+e =(1-b)>(1-4) 2 ад a) 


These inequalities yield а[($) – a] < ($) = 81а — 45a + 4 = (9a — 1) (9a - 4) > ©. 
So a < (1/9), since a < (4) by hypothesis. Thus, c = 1 — (a + b> 1- (1) – (5). ie 
с> $. We have, thus, proved our assertion, if 0 < p, p' < 1. However if p or p' is zero, 
say p = 0, then a = 0, b = p', c = q'. Clearly either b or c is at least rt 
Similarly, if p = 1, then a = p', b = q', с = 0 and either a or b is at least (3). 
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3-13. Random Variable Criterion 
A real-valued function X(o), o € Q, is a ry. iff (X sx} € F, for all x e R. 
Proof. Let X be a random variable. Then (X <x} e £,— о « x < o. Now, write 


(X«x) = ÜlXsx-(/ny. 


n=] 


Since for all n, (x < x — (I/n)} є F, it follows that the countable union of these sets, i.e 
(X € x] is an element of F. Thus, (X <x} e F. Conversely, let (X < x] є F, for all x and write 


(Ха) = fX «xam. 


n=] 
Since for all n, (X <x Fn Ё є F, it follows that the countable intersection of these sets, 
viz. {X < x} is an element of F. Thus, (X € x) e 7. Hence X must be a random variable. 
Theorem. If X is a random variable, then Z = aX + b is also a random variable. 
Proof. ((aX +b) xx) = (aX < x - b) 2 (X € (x - bya), if a > 0. 
((aX + b) <x} = (X 2 (x Ба} = (X < (x – byla)', if a < 0. 


{(aX + b) < x} = (b«x)- [5 DEN. n 


Thus, for all cases, ((aX + b) € x} € F, and consequently aX + b is also a rv. 
Exercise 3(a) 

1. Let X be a random variable. Then X? is also a r.v. 

[Aid : [X «x) 2 6 ifx «0, (X' sx) = (-/x «x <], ifx20, -. (X! x] e 71. 
2. Let X bear.v. then Y= 1/X is also a r.v. provided P(X = 0) = 0. 

[Aid : NEL D or Ne elk sy XS Old iX zo X-) 

= (Xe 1} Г (X <0} + (xX > 1) 11 X »0), etc.] 

3. If X is a random variable, then so are | X | and aX, (а = constant). 


4. If X and Y are two random variables on a probability space (О, F, P), then X + Y is also a random 
variable. 
[Aid : Show that (X + Y « z) =N[{X <r} fl (Y «z- r)], where union is taken over the set of 
all rational numbers.] 

5. Let X, 1 «i € n be r.v.s. on a probability space (О, F, P). Define 
M, — max (X,, ...., X,) by M,(o) = max (X,(o), ...., X,(@)}, for all o € Q, and 
N, 2 min (X,, ..., X,) by N,(@) = min (X,(0)], ..., X,(@)}, for all o € Q. Show that bcth M, and №, 
are random variables. 


[Aid : (M, <x} = (X, Sx, ., X, Sn) = ÜX, € x} € F. Also note that, 
i=! 
min {X,, ..., X,) z - max {-X,,-X,, -—-—« 
E 


3-20. Distribution Function and its Properties 

Let X be a one-dimensional random variable. The function F defined for 
the equation Р, (г) = P(X < г) is called the (cumulative) distribution function ot X. 
Notes. (i) We write c.d.f. for cumulative distribution function. Sometimes, only d. 
is written instead if c.d.f. 

(ii) Suffix X in Fy is used to emphasize the fact that the distribution function is associated 
with the particular variate X. When the particular underlying variate is clear from the 
context, we shall simply write F(t) instead of Fy(t). 

(iii) Tail events. Let х be any real number. The events (X < x), (X < x}, pu zx 
are called tail events. For distinction, we may label them open, closed, upper and 
lower tails. Often, simple r.v.'s. are expressed as linear combination of tail events. 


all real t, by 


Some Properties of Distribution Functions 


Property 1. P(a« X xb) = F(b) - F(a), (b > a). NU 


X sS a<x<b 


a b 
Proof. XS a) a LXS р US [by Point-set algebra] 
: Р(а<Х<Ь) + Р(Х <a) = Р(Х <Б) 
or P(a < X < b) = P(X < b) - P(X € a) = F(b) - F(a) [by transfer and Def.] 
Cors. 1. (i) P(a&Xxb) = F(b) Еа) *p(a)" [Р(Х = с) = p(c)] 
Proof. (ac X€b) =(а<Х<Ь) U (X-a) [by Point-set algebra] 
P(a < X <b) = P(a < X < b) + P(X = a) = F(b) - F(a) PX 2a) [by (1)] 


! (b). 


i? b Ру Ы 


(у \ 


11 FU / D) = PAD) =F 
S (a<X<b) = {a<X< 
ya Pias X «b) = P(a «X sb) -P(X = Б)= F(b) - F )- P(X = b), [(X 2 b) c (a € X € b) and by (1)] 
Proof. (a < X < b) = {a < X < b)} U (X 2 a) - (X- b). [by Point-set algebra] 
Since (X =b} c {a< X <b} U (X = a}, hence subtraction property of P gives, 

P(a < X < b) =P{(a < X <b) U (X=a)} - P(X = b) = P(a < X < b) + P(X = a) - P(X = b) 
= F(b) – F(a) + p(a) – рф) [by Property 1] 

Comments. When p(a) = 0 = p(b) which is indeed the case when X is a continuous 

variate [see Property 4] then 


Р(а<Х <b) = P(a < X € b) = Р(а<Х<Ь) = Р(а<Х « b). 


Property 2. (a) 0 € F(x) € 1 V [F is a bounded function] 
[F is monotonically non-decreasing] 


"Р л 
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Proof. (a) Since P is a probability measure: 0 < P(X <x} € 1 = 0 < Р(х) <1. 
(6) F(y)- F(x) = Р(х<Х<у) >20 = F(x) < F(y). E 1 and P(-) > 0] 


Limit Property 3. (а) L; = lim F(x)-0, i.e. F(-o) = 0, formally, 


(b) 2, lim Р(х) =1, i.e. F(o) = 1, formally. 


п o 
Proof. (a) Let (x,) be any decreasing sequence such that lim x, — —%. Then, the sequence 


of decreasing intervals, viz. {] — ©, x, ]) yields : lim ]- ©, x,]= i» oo, x, ]) 7 Ø 


n=] 


Hence, P(lim ]- oo, X, ) = Р(@) = 0, i.e. іт P(]-o,x,] =0, [by Continuity of Р]. 


n— oo 


no 


Thus lim F(x,) =0 > F(lim х„) = F(—o) = 0. 


(b) Let (x,) be an increasing sequence of real numbers such that lim x, — ©. Then, the 
sequence of increasing intervals, viz. {]-00, x,]} yields : 


lim]—-9,x,] = ee os set 


noo 


p(lim]-2.x,] = P(Q)-l ie. limPQ-«.x,)-1 [by Continuity of P] 
Thus lim F(x) 21 =>  F(limx,)=F(+0)=1. 


These properties show that the graph of the 
function y = F(x) must approach the line y = 0.  ------- 
at the lower end and line y = 1 at the upper 
end. In other words, the lines y = 0 and y = 1 
are pio & to us curve y = F(x). 


GRAPH OF DISTRIBUTION 
FUNCTION 


Proof. (i) Let (x,) be a Vestes te sequence of m numbers such that x, > a and lim 
x, = a. Then the sequence of intervals, viz. ([-~, x Pisa decreading sequence of 
intervals and so 


lim ]-,x,] = [1(1-®,х„]}=1-%, а]. 


no n=1 


P{lim ]- o,x,]) = P(]-o, a]) = P(X € a) = F(a), 


i.e. lim P(]-9,x,]) = F(a), [P is continuous]. 
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Thus lim F(x,) = F(a), or Е(а+) = F(a) > F is continu 


п со 
ee Р * „те QU at n ed. V n a 
(ii) Let (x,) be an increasing sequence of real numbers such that x, hd 
is an increasing sequence of 


lim x, = a. Then the sequence of interval { ]—%, x,1] 
intervals and therefore, 


ous from the right. 


шай, Xn] = О-о, х,]}=1- 241. 
nzl 


y = F(x) 


yz! 


RIGHT CONTINUITY OF 


DISTRIBUTION FUNCTION 


JUMP F(a) — F(a) = P(x = a) 
DISCONTINUITY 


F(a) 


p{ tim ]-©, х, = р{]- о,а]} or lim P(]- » х„]) = Р(Х <a), [by Continuity of Р] 


i.e. lim P(t) = P(X«a) => F(a-) = Р(Х < a) 


As {Х<а} = (X « a) U (X =a), hence 
P(X <a) = P(X«a) + Р(Х=а) => F(a-) = Р(Х <a) = F(a) - Р(Х = a). 
Thus F has a jump discontinuity at x = a where x — a from the left, with the jump value : 
PX = п), = F(a) — Fla =): 
Remark. If c.d.f. Е is continuous at a, then F(a) = F(a –) and so P(X = a) = 0, i.e. if the 


c.d.f. is continuous, then the underlying random variable takes any particular (point) 
value with probability zero. 7 


| Summary of Some Properties of а c.d.f. 


б< Fiz) = Т, 


2. F is non-decreasing, i.e. if x € y, then F(x) < F(y). [Monotone increasing Property] 


Ух є К. [Boundedness Property] 


Porn = |. That is li iyd М 
(—) = 0, F(+) atis lim F(x,)=0, lim F(x,)=+1. [Limits Property] 


4. Е is continuous from the right at each point, i.e. F(a+) = F(a). [Right-continuous Property] 
F(a*) - F(a-) = P(X = а). [Jump Discontinuity] 
5.P{a< X < b} = F(a) - F(a). [Interval Property] 


[Conditions (2), (3) and (4) are necessary as well as sufficient for F to be a c.d.f. on К) 


119 


Note. lim means the limit is taken with x decreasing to a (i.e. from the right) and lim 


хуа 


§3-30. Discrete Distribution 


means the limit is taken with x increasing to a (i.e. from the left). We often write lim 
F(x) = F(a*), lim F(x) = F(a-). "P 
xia 


Comments. If we define F(x) = P(X < х}, then it is left continuous, not right continuous, vide 


Р(Х = +1) = 1, Р(Х = 0) = 


i T 

a? 2 

3-21. Worked-out Problems 

Example 1. Give reasons why each of the graphs of F given below does not represent 


a distribution function. 


О 


(с) (d) 
Solution. (a) F(x) < O (negative) for some x. (b) F(x) > 1 for some x. 
(c) F is not non-decreasing i.e. sometimes F is decreasing also. 

(d) F is not right continuous at x = k, in fact it is left continuous. 
Example 2. Show that the function F defined by : 
F(x) 20,x <3; F(x) = 1, x >3 is not distribution function. 
Solution. Here 0 € F(x) € 1 V x є К, and Е(-о) = 0, 
F(+0) = 1. Also F is monotonically increasing. 
However, 


Е(3+) = lim F(x)=1; F(3) = 0, since F(x) = 1 V x> 3. 
х 3+ 


As Е(3+) + F(3), Е is not right-continuous, so F is not 
a c.f. 


Problems with Solutions Provided at the End of the Text 


1*. Show that the function F defined by, 
F(x) =0, х= 0; F(x) =k In x, 0, <x <3; F(x) =1,x23 
cannot represent a c.d.f. for any non-zero constant k. 

2*. (i) Show that, if a < X < b, then F(x) = 0 for x < a, and F(x) = 1 for x > b. 
(ii) Show that X(o) < Yio) Уо є ШКЕ Еу). 


3-30. Discrete Distribution 
Let X be a random variable defined on an arbitrary probability space (ak Duae. 


distribution function Е defined by F(x) = Р(Х < x) plays a pivotal role in the theory of 
robability because it completely determines the probabilit distribution of X. In 


$ 3-21(4) we noted that if F is continuous at a, then P(X = a) = 0. And if F is not 
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continuous at a, then Р(Х = a) = F(a) — F(a-) > 0 is the jump in F at a. Accordingly, we 
categorise random variables on the basis of their distribution functions. 


Definition 1. Let X be a r.v. on an arbitrary probability space (О, 7, P). If the c.d.f. F 
of X is discontinuous and its graph is a stair case form (shown in the Fig.), then X is 


said to be a discrete r.v. 


y = f(x) 


Since the d.f F of any variate X is bounded and monotonically increasing, it (F) can 
have at most countable number of points of (jump) discontinuities. Label these points 
of discontinuities as x,, х), ..., X, and observe that : 

P(X = ху) = F(x),- Fa). > 0) V4 РВЕ) =0. V x£ {x,, х,,...). 
Let p(x) = P(X = x), then p is a non-negative function which is positive only at the 
points x,, x5, x4, ... This leads to an alternate definition of a discrete г.у. 
Definition 2. A r.v. X 1s said to be discrete, if there exists a non-negative function p 
which vanishes everywhere except at a finite or at a countably infinite number of 
points such that its c.d.f. is given by 

Fix) = Lp Nox 

Probability Mass Functions. The function p given by p(x) = P(X = x) = f(x), say is 
called probability mass function (p.m.f..) or discrete density of a (discrete) variate X. 
Observe that: Р{о : X(@) e A} = P(X € A) = P(A) = Ур(х), V xe A. 


3-31. Discrete Density Theorem 


Let X be a discrete г.у. with p.m.f. p(x); then (a) р(х) 2 0, 
Proof. (a) Since p(x) is the probability function (p.f.) of X, so р(х) = P(x = х) > 0, V х. 


х, < 0 


(Ь) By definition, F(x) = У, pon) V x, so lim Р(х) = X pla). ari) 


Since lim F(x) = Е(+о) = 1, У p(x) = Ўр) result (1) provides the statement (b). 
ro i=l 


x, So 
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3-32. Worked-out Problems 


Example 1. If the variate X denotes the maximum score obtained in k independent 
tosses of a fair Die, find the p.m.f.. of X. 


Solution. Let X,, X», ..., X, denote the k-scores, so that X = max (x,, х), ..., х). Now 
P(X € x} = P(max (Х|, X,, ..., AS S PIX US x S x, «oy, ХИ А] 
= P(X, xx) . P(X, <x)... P(X, € x), = (Р(Х, < x))* = (x/6)*. [By indep. and by symmetry] 
P(X = x) = Р(Х < x) - P(X < x 1) = (х/6)* — [x — 0/6] = p^ - (х— 16, 1 <х<6 ...(1) 
For 2 dice k = 2, Р(х = x) = (2x - L)/S6,. iS x.s 6. 
Note that as k — oo, 


k k ў 
(Хех с 3 4 к П, ifx=6 
p lim (2 [ | б Ol dfox a6. 


Example 2. A random variable X has the following probability distribution : 


x 0 1 2 3 4 5 6 7 8 

p(x) k 3k 5k 7k 9k 11k 13k 15k 17k 

(a) Determine the value of k. (b) Find P(X < 4), P(X = 5), P(0 < X < 4). 

(c) Find the c.d f. (d) Find the smallest value of x for which P(X < x) > 0.5. 


Solution. (a) Xp(x) 21 > k(1+3+5+7+...+17)=1 = К = 1/81. 


(b) P(X<4) = P{(X=0) О (X=1) U (Х= 2) О (X23) 
= pọ +P; +p, + Py =k + 3k + Sk Tk = 16k = 16/81. 


P(X>5) = Р{(Х= 5) О (Х=6) О... 0 (X=8)} = p; + po + p; + py = 56k = 56/81. 
P(0«X«4) = P{(X=1) U(X-2)U (Х = 3)) =p, + p; + р, = 15k = 15/81. 
(c) She ditus F(t) = P(X s t). 
FO = PX = 0).=k, FA) wer P(X& Deak KOS P(X.s2)- 9k 


FG) = PSB) 2.16k, F(4) = P(Xs4)z25k, Е(5) = P(X < 5) = 36k 
F(6) = P(X < 6) = 49k, FQ) = P(X <7) = 64k; - .F(8) = Р(Х € 8) = 81k. 
Observe that Р(Х « 4) = Р(Х <3)\=FG)'= 16k; etc. 
PX =з) = КЕР <5) = 1+ P(X s 4 = bh 25k = 86/81. 
P(0 < X <4) = F(4) - F(O) – р, = (25 - 1 - 9)k =15k = 15/81. 


(d) F(x) F(5) = 36/81 = 0.44; F(6) = 49/81 = 0.61. 


у, 
2 , 
Thus, the smallest value of x for which F(x) > + is x = 6. 


Indicator Notation. lt is usual to express F(x) in expanded form or in condensed form 
using indicators for individual ranges. 


0 «e < x < () 
k. k xs 0 
F(x)71 4k x&1 


ed 


F(x) = 0 ре с Го, оу (x) + 4k Го, 1] 0) + 9k I, 340 + 16k lg з) 02 = 25k Io, 4, (x). 
We may even rewrite the indicator form as 
F((x) 20 (о < x < 0) + А0 < x <0) + 4k (O «x < 1) + 9k K(0 « x 2 2) +... 
Problems with Solutions Provided at the End of the Text 

1*. A random variable X takes values 0, 1, 2, 3, ... with probability proportional to 
(x + 1) (1/5y'. Find Р(Х < 5}. 

2*. The variate X has p.m.f. p(x) = 2(x + 1)/(л + 1) (n + 2), x = 0, 1, 2, n. Events A 
and B are defined by (X < m) and (X < 0} respectively, where ORW m <n. 
Construct an appropriate model conditioned on A and also evaluate P{B | A}. 

3*. A weighted coin, [P(h) = 2, P(t) = 1] is tossed three times. If the variate X denotes 
the number of heads produced in three tosses, find the c.d.f Fy) and p.m.f. f(x). 


/4*. А random sample of three teachers is chosen from the list of Academic Council 


(A.C.) members of Delhi University. If the proportion of A.C. members who are 
senior teachers is 0.4 and the number of A.C. members is large, find the p.m.f. 
and the distribution function for the number of senior teachers in the sample. 


“5*, The game of chuck-a-luck is played as follows : Three fair dice are rolled. A player 


w 


A bets Rs. 1, on the occurrence of one of the integers 1, 2, 3, ..., 6, say k. Then 
if one k occurs (on the 3 dice) A wins Rs. 1, if two K's occur A wins Rs. 2, and if 
three k’s occur, A wins Rs. 3. If no k’s occur, A loses Rs. 1. If variate X denotes 
the net amout A wins in one play of his game, find the distribution function for 
X and compute P(0 « X <3), Р(Х € 0), P-1« X < 0). 


/6*. Let PIX wb! = mee — ap. (a, b) = 1, (a, b +ve integers). 


Find K and evaluate P(X « 1) and P(X x 1). 


3-40. Some Standard Discrete Distributions 


Some commonly occuring probability mass functions (p.m.f.) have acquired definite 
terminology. We quote these probability laws (distributions) which will from a part of 
solid core in the ongoing study of Probability Theory. 

1. Degenerate Distribution : 


Let D be a discrete subset of К and c є D. If P{X = c] = 1 and P(X + c] = 0, then Р: 
D > R is called degenerate distribution. It occurs naturally as the distribution of a 
constant r.v. viz. X : О > К such that X(@) = c, V o є О. T. 
2. Uniform Distribution : 
Let S be a finite subset of R, say 5 = {x,, x», ..., x,). If 

P(X =x) = f(x) = Vn i=1,2, n i f(x) = 0, otherwise, 
then f is called a uniform distribution. It is an index of equi-likelihood in probabilistic 
modelling. 

2e. Ж} Or X ~ unit (x, 


Notation : X ~ Ulx,, x», <--> X, LEE Mp) 
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3. Bernoulli Distribution : 


Let O0<p<1,p+q=1, and define P(X = 1) = = f(1) = p, P(X = 0) = (0) = q. The f is called 


Bernoulli distribution. It deals with indicator r.v., viz. X,(@) = l, o € A; X,(o) = 0, 
ХА НЕТЕШ that aes = 1) = P(A) = 1; P(X, = 0) P(A) = д. We shall often write 
Дх) = Р(Х = х) = “p',x=0, 1. Notation : Х ~ Вег(р), ог bin (1, р). 


4. (Bernoulli) mem: Distribution : 
Let O<p<1,p+q=1,n>1 and define 


Р(Х = х) = f(x) = (") ратует f(x) = 0, otherwise. 


Then fis called a binomial distribution with arameters n and p. Notation : X ~ bin (n, p). 
Here г.у. X records the number of successes іп n Bemoulli- trials with constant success- 
probability p. 


Note. fi)- X È x (ja TRS "FG) = уз (7) а" "р" uœ- 0). 


5. Poisson Distribution : 


-À 4x 
——- та moram m fix) = 0, otherwise. | 
Then ре а а qne D onm with parameter A ( > 0). [Notation : X ~ Pois (2.)] 


a xa 
= "2 Бо) = = » u(x — p. 


6. Geometric Distribution : 
"P(X =x) = Дх) = фр, x = 0, 1, 2, 3, - — [Notation : X ~ geom (p)] 
Pascal Geometric Distribution or f.f.t. Distribution 
XY = у) = Ќу) = ne р, у = 1, LE 3 Notation : Y ~ gem (p) 
P [First success on ial Mos. A n Ap. [f.f.t. : for the first time] 
Note that X2Y 41. 
7. Negative Binomial Distribution : 


Let 


Note. 


Here X alicia of failures € dio kth Y mM that geom(p) = NB(. PE 
Pascal Neg-binomial Distribution : [Notation : Y ~ NB*(k, p).] 


Note that Y = X + k and gem (p) = NB*(1, p). 


Ero» £ en (т) neo] A OGA) 


8. Hypergeometric Distribution : 


H-G Model 
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—————————— o eN 
X — HG(N, М, n) 


max {0, M + n- N} < x < min (M, n)} Notation : 


9. Logarithmic Series Distribution : 
Дх = -0'/[х In (1 -0),0<0<1, х=1, 


10. Multinomial Distribution : X = (X,, X, -- Xj) 


B. 


P{X, =X; X, = Xz, X, 7 x,) = М $ " М I » p^ e DU 
Wr А л 
where : 0 <р; < 1, р +р, +... +р = 1, х +X ++. +X En. Notation. Х ~ Mul (л, k ; р) 
Trinomial Distribution : 


А’. б) 


п iy T E 
fix, y) = PX Ex уу) = S cay)? 4 (1-р-4) 


$»9€0,1,.2,..,n,x -*y snO0spq«l.ptqsl. 
Another Usage : fGx,. X5, X4) = ( n Ја" HA m + Xa tag = 1, Py + P2 +р; = l; 


X X4 


0< p, P» Рз 5 1. 
Comment. In all distributions, we always take P(X = х) = 0, when x is different from 
the stated range (or support) of X. 

Exercise 3(b) 


“1. Give reasons why each of the graphs of F given below does not represent a distribution 
function. 


JA 2. Show why a function F defined as under, does not represent a c.d.f. ? 
552 
с F(x)=44 2«x«3 [Е(2 +0) = F(2)] 
W Ж 3 


3. Ifa variate X assume three values 0, 1, 2 with probabilities 1, Li respectively, find the c.d.f. 


of X and show that P(X € 1) = i, 

— 4. Let Q= ((a, Б), :a, b € (1,2, ..., 6)) and F be the set of all sub-sets of Q. Let P((a, b)} = 1/36. 
for all 6? pairs (a, b) in О. Define X(a, b)=a +b, 1 £a, b, « 6. Obtain the cdf of X. 

— 5. A random variable X can take all non-negative integral values and the probability that X 
takes the value r is proportional to a , (0 < a < 1). Prove that P(X = с) = И оа". 


Exercise E 1 2O 


6. A random variable X assumes the values 1, 2, 3, 4, 5 such that 
P(X = 1) = Р(Х = 2) ; Р(Х =4)у= Р(Х = 5); P(X«3) = Р(Х = 3) = Р(Х > 3). 
Write down the distribution of X and show that P(X < 3) = 2 A 
7. Arandom variable X assume the values —3, —2, —1, 0, 1, 2, 3 such that 
P(X > 0) = P(X = 0) = Р(Х = 0), Sees vom RR P(X = 1) = P(X = 2) = Р(Х = 3). 
Write down the distribution of X and show that P(X < 1) = i i 
8. Let p(x) be the probability function of a discrete variable X which assume the values Х|, х), X4; 


10. 


11. 


12 


. 


13. 


„Ла. 


Sis. 


x, such that 2p(x,) = Зр(х,) = р(х) = 5р(х,). 
Show that ya m.f.. of X is 15A, 10A, 30A, 6A, where A = 1/31. 


. Let p(x) = 3/5, х= 1, 2,3, 4, 5, р(х) = 0, elsewhere. Show that P(X = 1 or 2)= + and Pi pee 


(= HASi) = ue 
The p.m.f. p(x) of variate X has values. 
p(0) = ЗК, p(1) = 4k — 10k”, p(2) = 5k — 1, р(х) = 0 elsewhere, k > 0. 
(a) Find k and P(X < 1), P(X <2), P(.1<X <2), P(0 « X <3). 
(b) Describe the c.d.f. F( - ) of X and sketch its graph. 
(c) Find the largest a such that F(a) « 1/2. 
(d) Find the smallest b such that F(b) > 1/3. 


о) X. PQCX«3)9 3,221, 5-2] 


Let X be a random am with p.m.f.. given by 
E -2 -l 0 1 2 3 7 12 
ДЮ 0.1 0.15 0.2 0.2 0,15 0.1 0.05 0.05 


What is the probability of the event that : 
(a) Xis even ? (b) X is negative ? ? (c) X is less than (—1) and odd ? (d) X takes a value between 


1 and 8 inclusive (e) X aor [Ans. 0.5 ; 0.25 ;0;0.5 ; 0.8] 
A variable X has the following p.m.f. : 

ist 0 1 2 3 4 5 6 7 
fo: 0 k 2k 2k 3k k? TTE FW. 


(a) Find k and evaluate P(X > 4), P(X « 6), Р(Х? < 6) and P(1« X? a Ty 
(b) Determine the c.d.f. of X and P(X € 5). 
(c) Find the smallest value of x for which P(X < x) > 1/2. 
[Ans. (a) k= 1/10, 0.81, 0.30, 0.70, (c) min x = 4] 
For a variate X; PX =k + 1) =aP{X=k};k=0, 1, 2,3,..,0<a<1. 
Find the p.m.f. for X and show that P(X = odd number) = 0/(1 + о). 
A variate X ranges over : R, = {-n,-n + 1,...,0,..., 1, | Mca lke 
Suppose we want 


P(X=-k) = P(X 2 Кап P(IXIs k& 1) = 2P(IXI- KJ. 


Find the p.m.f. for X and evaluate P(X # 0) and P( 1 X| = 3j) for some integer j. 
A random variable X assumes values which are rational numbers of the form n/(n + 1) and 


(п + 1)/n, where n= 1, 2, 3, ... . If 


16. 


19, 


20. 


21. 


n+l 
p[X = п/(п + 1)] = P[X=(n+ Lyn] = (1) ў 


verify that this assignment of probabilities 15 permissible and find the c.d.f. of X. 


An urn contains 4 balls numbered 1, 2, 3, 4 respectively. Two balls are without 
replacement. Let X be the sum of the two numbers that occur. Obtain the pre iy function 
for X. How is the probability function modified if the two balls are drawn with replacement 


[Ans. 3) =Д4) = 405) = f(60 = 70) = p 


| 
I 


f2)= Lf8)-1f)- 156) =4 f(9 3/00 = /( = p - 3. 


. Provethat: PAIX = х) 2 P(BIX = x) V xsc 9 P(AIX& c) = Р(ВІХ S с). 
18. 


A random variable X has the following probability function : 
E. -3 -2 -] 0 l 2 3 
р(х) : 0.08 0.14 0.19 0.27 0.17 0.09 0.06. 


Find (ће density function of Y= (1X — 11+1Х+ 11}. [Ans. f(2) = 0.63, f(4) = 0.23, f(6) = 0.14] 
An experiment consists of three independent tosses of a fair coin. Let X, Y, Z denote the 
number of heads, the number of head-runs and the length of head runs respectively. [A head- 
run is defined as consecutive occurrences of at least two heads. Lengh of head-runs is the 
number of heads occurring together]. Find the probability function of X, Y, Z, U = X + Y and 
V = XY. Also construct probability tables and draw their probability charts. 
4Ans. x= 0, 1, 2,3, p, 2 p, 3p, 3p, p; y 20, 1, p, = 5р, 3p. 
z=v=0, 1,72, 3, p, =p, = 5p, 0, 2p,p,u-0,1,2,3,4; p, = p, 3p, p. 2p, p] 
An organism of n cells is examined to determine the number of live cells it contains. 
A histologist suggest that the density function describing this number is 
p()28'(1-0),x20,1,2, .,n-1; р(х) = Ө", х=п 
where 0 < 0 < 1. On this basis, find the probability that an organism contains both dead and 
live cells, and show that it is less than 1 — (1/n). 
A random variable X has density function p(x) = defined by 
X к 1 2 3 4 5 6 
р(х) : 0.04 0.15 0.37 0.26 0.11 0.07 


What is the appropriate model conditioned оп (ће event А = {X > 4} ? Verify that : 
P{X=41A}+P{X=S1A}+P{X=61A} - I. 


Show that (a) P(X odd | X <5} = + (b) POC&S |X odd] = 41/52, (c) P(X 2 41X #3} = 26/63. 


. The number of operations required to complete a certain process is variable, but the process 


is certainly completed in at most 2n operations. The mechanism of the process suggests thal 
the density function describing the number of operations required is 
р(х) = 0" (1-0),x2 1,2, ...,2n- 1; p(x) = 0"! «225 
where О < Ө < 1. What are the probabilities that : 
(a) the process will be completed before the kth operation ? 
(b) at least k and at most 2n — k operations are required to complete the process ? 


If the supervisor 1 attends odd-numbered operations and supervisor 2 attends even-numbered 
operations, show that supervisor 1 is the more likely to see the process completed provided 
20" +0 - 1 <0. 
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$3-51. Theorem 


3-50. Continuous Random Variable 

1. Definition. Let X be a random variable on a probability space (Q, F, P) with F as 
the c.d.f. of X. The variate X is said to be continuous if there exists a non-negative 
function f, [f(x) > 0 V x є А] on the real line such that 


F(x) = [^ f@dt эм үү 
is a continuous function of x. Thus, r.v. X is continuous, if its c.d.f. is continuous. 
The function f, satisfying relation (1) is called the probability density function (p.d.f.) of X. 
Remarks. The word continuous in the above definition is misnomer. A random variable 
X is a function and the notion of continuity for any function in Mathematics is well 


established. But in the case of continuous variate, the word continuous is not used in 
its usual sense. 


Even random variable is, neither random nor variable, but is a function. 

2. Absolutely Continuous Function. A function which may be expressed as an 
indefinite integral is called absolutely continuous function. 

The following facts about absolutely continuous functions are assumed : 

(i) Absolutely continuous function is always continuous, but the converse need not 
be true. 

(ii) Absolutely continuous function is differentiable everywhere except at a finite or 
countable number of points. 


These facts establish that a variate X is continuous iff its c.d.f. F is absolutely continuous. 
Hence, for a continuous variate X, the c.d.f. ‘F’ is always continuous. Note carefully : 
a continuous variate is one whose c.d.f. is continuous and further it can be obtained 
by integrating a non-negative function f as in (1). 

Singular Distributions. There are examples of variates whose c.d.f. is just continuous 
but the variates themselves are not continuous, 1.e. the c.d.f. is not absolutely continuous. 
These types of distributions are known as singular distributions. 


Singular distributions are seldom considered in this book. 


3-51. Theorem 
Let X be a continuous variate with p.d.f. ‘f. Then, 
(1) РХ = a} = 0 (Point-probability is zero) 


| > 0, (Normalization Property) 


(iii) Plas X <b} = [fco dx. 


Proof. Since X is a continuous variate with p.d.f. f, the c.d.f. F is continuous. 


F(x) = ff dt. m 
-) and thus P(X = a) = F(a) - F(a-) = oğ 


rms N 
а А -- J Dy f 2 
р Se OR Lo 


(1) Since F is continuous, 
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GD 1 = Fo) = lim F(x) = lim = f^. fdr = f fO dr. 


n» o 


(ii) Р(а<Х <b) = F(b) - Еа) = ло dt — f лаа = f f(t) dt. 


Remarks. (i) For a continuous variate, point probabilities are Zero. 

(ii) Area under the probability curve y = f(x) is unity ; the fact f(x) > О implies thai 
graph of f(x) is above x-axis. 

(iii) Area under the graph of probability curve y = f(x) bounded —— or allia 
simply P(a < X < b). 

3-52. Nomenclature of p.d.f. 

The relation between p.d.f. and c.d.f. is 


FG). m] - уу x жч 
By the Fundamental Theorem of Calculus, к= 
dFldx = F(x) = Кх). ө» 


at every point where f is continuous. As 
per definition of derivative. 


F(x +h)— F(x) _ 


P(X <x+h)-— P(x<h) 
m 
h-0 h 


li 


RER 


lim P(xsXsxth)_j) rA E TN 


h—0 h h>0 h 


This shows that density f represents the limit of the ratio of the probability over an 
interval of length, to the length л of that interval, as А — 0. It is for this reason that f is 
called p.d.f. 

Comments. The result f(x) = F'(x) enables us to derive the density of a continuous 
variate X from its с.1.{ But the equation is valid only for the continuity points of f. We 
recall from the properties of absolutely continuous functions that F will be differentiable 
everywhere except for a finite or countably infinite number of points. The points 
where the c.d.f. ‘F’ is not differentiable are those points where the graph of F has 
sharp edges, and at such points we assign to f, any value we please, without disturbing 
the basic probability law associated with the random variable. We shall assign values 
to f in the most convenient way, suitable to given situation. As such, the density / à? 
c.d.f. F are always connected by 


x "e 
(i) Fs fi fod v хек, a) "Te p) v xen 


These observations are exemplified in the following problems : 


и. 


А $3-54. Probability Density Function ^" 1 ^, 9 


3-53. Worked-out Problems 
Example 1. In terms of continuous f,( - ) and FX * ), find 
(i) P[X»a-*AxlX»a], (ii) Pla<X<a+AxlX> a] (iti) lim (ii)/Ax as Ax > О. 
Solution. For precision, write Ax = h ; and observe that X is continuous Now, 
P(X >a+h,X>a) 1 (X >a+h) _1-F,(a+h) 
P(X >a) P(X>a) — ЕД0). 
Draw a figure to help understand (X > a + h} N {X >a} ={X>a+h). 
Р(а<Х<а+һ)  Fy(a* h) — Е, (а) 


(i) ру = 


il = = 
ЫБА Fo __ f@_ 
TW 1450 1— F,(a) b= Руба) t= F, (а) 
Illustration. Let f(x) = Xe", then F(x) = 1 — e™. Then 
-А(а+ л) —A(a+h) -Àa —Àa 
€ —Ah [1 TE ] P [1 nid ] e ^: Àe 
= = ё Op —————————— _ = 1 - ; — =À. 
P, сда 2 Er PY py 22а 


Comments. If F(x) = (1 – e^ u(x — a), then f(x) = F'(x) = (1 - e^ d(x — a) + Ae "(x — Е. 
Example 2. (1) (Baye's Reversal Rule). Show that 


Fy(x lA) = [P(AIX <x). Fy(x)]/P(A). "wd d 
(ii) Show P(A) = P(A I X € x) F(x) + P(A | X > x) [1 - F(x)]. 2) 
г : 23$ A АЕРДЕ); А} P{X < x), A} A} 
Solution. (i) By definition : Fy(x | A) = SED. up PAIX S x)- Р(Х <х) 


Eliminating the number P{(X < x), A} yields (1). 

(ii) Let B= (X <x}, В = (X > х), whence P(B) = F,(x), P(B) = 1 - Р(х). 
Substituting these in the Multi-Stage p-Rule : P(A) = P(A | В) P(B) + P(AIB) P(B) 
yields (1). 


3-54. Probability Density Function 
A function f is called a probability density function (p.d.f.) if it satisfies the two conditions : 


== ЗД negativity) 


s discrete, Or - ОРО) dx =1, when X is continuous. [Normalization] 


Note. When X is discrete, f is called probability mass function ; but now-a days the 
term ‘density function’ is used both for p.m.f. or p.d.f. 

Remarks. In this definition of density function, we have dispensed with introduction 
of distribution function. We may observe that conditions (1) and (2) are the same as in 
conditions (ii) of Theorems in Art 3-31 and 3-51. 


3-55. Worked-out Problems 
Example 1. (a) Can the following be probability functions : 


2, xzl нык = ~ | 
fo = jg х=2 5 £o 24$ А! 
0, elsewhere 0, elsewhere 
-1, х=? me O«xsl 
дю = |} хат мо = ш. 


0, elsewhere 
Solution. (1) Here ў (х) 2 0 V x, Ху (х) = 1. Hence FART a p.m.f. for some variate X. 
(ii) Неге (х) 20 Vx, 260) = 1+2=2 #1,/, is not a p.m.f. 
(їп) Here f,(2) = —1«0, hence f, cannot be a p.d.f. yee vx 
(iv) Here f, is not a p.d.f. since f(x) 2 0 V x, but 
Ehad = f ax dx |а - 20) 214 - 321. 
Example 2. Prove or disprove : If f, (x) and f,(x) are p.d.f's and if 0, + 0, = 1, then 
g(x) = 0,f. (x) * 0; f, (x)-is a p.d.f. (mixture of densities) 
Solution. Define f,(x) = 1,0 <x € 1; f,@) = 1, 1 < x < 2. Choose Ө, = 2, 0, = –1, then 
g(x) = 0, fi) + 0, f(x) = 2f,(x) = 00). 
Now 80) = 24(4)-fiG)=-1 (063) -0as + єп, 21} 
We conclude that g is not a p.d.f. 
Remark. If we impose 0 < Ө,, 0, < 1, then g is always a p.d.f. 
Example 3. For the density f(x) = Ke “(1 — e ^) [o „у (x), find the normalizing constant 
K, Еу(х) and evaluate РОХ >41): 
Solution. (i) For norming constant К, 
1 = K[ ee a= к gy ae pm x! dx| = к\1 E A 
Thus, К = 2a; and so f(x) = 2a (e ^ - е 


(i) Fy) = ру) dt = 2a [ie е) dt=1-2e +e", Dex о, 
(iii) P(X > 1) = 2af (е © -e?")dx- 2e * - е2] = 264 еда, 
Note. P(X > 1) = 1— Р(Х < 1)=1- Е) =1- р a Q7 te? ]z2e7 2e 


Example 4. A variate X has p.d.f. f(x) = Cre"? 0< ih uU e 


If n independent observations X,, X», ..., X, of X are made, what is the probability that 
Y > 4k, where k is a positive number and Y = тах. [X,, cwm 


§3-55. Worked-out Problems 1 3 1 


Solution. We determine C using normality | f(x) dx=1. Thus, 


1 


EXE Xx _. uL. X оор "yz 
ci, xe dx=4C |e a= 4c, r- $ лада | 


Thus C = 2. Now, 


P(Y»4k) = 1- P(Y <4k}=1- P{max.(X,, X,,.... X,) < 4k} 
| - P(X, < 4k, ..., X, « 4k} 

| - [P(X, < 4)]" [^ X, are 1.1.4. and Product Rule] ...(i) 
P(X, «4k) = [+ 


0 


n 


SA k? _ B 
дез а= (| = е). 


Making substitutions into (i) we get P(Y > 4k) = 1 ~ (1 sg dM. 


i"; 


P 


A*. 


Problems with Solutions Provided at the End of the Text 


Let F be the c.d.f. of a continuous variate X 
defined by 


By ons 
Е(х)= į% Osxsl, 
b! - xou 


Find the p.d.f. of X. Use both F and f to evaluate 
Pils ox 5.2) and Р(1 x X < 2). 


The c.d.f. ‘F’ of a continuous variate X is given by 


0, x«0 

Pa O<x<t 
F(x) = j у E 

ОЗА $h2x«4 

1, к=з. 


Find the p.d.f. of X and evaluate P( | X | € 1) and etn < X « 4), using both F and f. 


Obtain the density function for the variate X 
whose distribution is specified by 


0, x «0 
Р 1, 0sx«2 


FE = $, 2a r23 
lL x23 


The d.f. ‘F’ of. a continuous variate X is 
defined by 
F(a) = 0.5, F(b) = 0.7, F(c) = 0.8. 


1 32 One-variate Distribution Theory 
Evaluate P(a € X < b), P(b < X < c). Calculate also the probability that two 
independent observations X, and X, will lie between —=© to a and c to oo. 
S5*. Let X be continuous with p.d.f. 
fo) = kx - x), a«x«b,k» 0. (1) 
Find the possible values of a, b and k. 
6*. Determine the distribution function F(x), for the following density function and 
calculate F(3) : 
3/3 0O&zsl 
Дх) = 45(4- х)/27, 1<xs4 
0, elsewhere 


7*. X is a continuous variate with frequency : f(x) = 1 ke", к> 0, (—оо, о). Verify 


that f is a density function and derive F(x). 

8*. Life X in hours of a certain radio-tube has p.d.f. 

Дх) 2100/3, x > 100; Дх) = 0, x < 100. 

Find the distribution function of X. What is the probability that none of three 
such tubes in a given radio-set will have to be replaced during the first 150 hours of 
operation ? Find the probability that all three of the original tubes will have been 
replaced during the first 150 hours. 

9*. A wood-boring larvae travels a distance X(cm) along a long rod as per p.d.f. 

f(x) = 0/1( € x)*', x>0,0>0; Дх) = 0, otherwise 

where 0 is the measure of hardness (m.h.) of wood. 
(a) Check that Ө is a sensible m.h. of wood by showing that P(X > a) decreases as 
0 increases. 
(b) What m.h. of wood ensures a probability of more than 99% that the larva is 
within | cm of the starting point ? 
(c) Show that the m.h. of wood which maximizes the probability that the larva has 
travelled between 1 and 2 cm from the starting point is [by (in 3/n 2)]/ün (3/2). 


3-60. Some Standard Continuous Distributions 


Some commonly occuring probability density function [p.d.f.] have acquired definite 
terminology. We quote these densities which will form a part of solid core in the 
aes study of Probability Theory. Notation follows the name of distribution. 


. Uniform (or rectangular) distribution. X ~ U(a, b) or X ~ unif(a, b). 
Kx) = Wb - a), a < x < b, f(x) = 0, elsewhere, [b > a, — < a < e]. 


Fi) = 0 Mex <a) + [x = aN аў] Ma < x< b) «V z b. 
3, Normal (or p distribution. X ~ isis o^). 
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The Standard or unit normal distribution, notated : X ~ N(O, 1) 


0270, 


M = 1 — 1 x 1210. 2 zo 
fix) = Ол ERE hee co, Р(х) Jom {те dt = Ф (х) [Standard notation] 


3. Log-normal distribution. X ~ (n N(u, o?) 


ped 1 (ол -= 
a2 —— 1 exp| ш UP 


Terminology. X ~ (п (Named distribution) iff 0п X ~ (Named distribution). 
4. Gamma distribution. X ~ gam (a, i) 


ex a-l 


fœ) = 
TOA 
9. oh ааа distribution. Х ~ Expo (А). 


И = еъ 0, f(x) = 0, elsewhere, [Expo (A) = gam (1, A)] 
6. Chi-square distribution. X ~ em - [n is called degrees of freedom] 


Bong xy, it x SO 


202-1 — 
— х 20, f (x) = 0, elsewhere 0, = gam (n/2, 1/2)] 


7. Beta distribution of the first kind. X ~ B, (a, b). 
ПЕЕ Ва, b), a> 0, 550,0 << 1, 
8. Beta distribution nent the second kind. X ~ By(a, b). 


- nail p>, Ост. 


10. Cauchy Eod con. p^ Chy (a, b). 


NN... lal«o, —o«x«oo. 


11. Student's t-distribution. X — t(n). 


12. Snedecor-Fisher F-distri [or X ~ F(m, n)] 


13. Rayleigh distribution. X - Ryl (a, А) 
f) = 23-a)e?*79 x28, f(x)=0, х<а. 
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EE oe rA aval. ^ — 
14. Logistic distribution. f(x) — DUIS ОИ = exp — A(x -a)l ; A > о, 


lal«o,Ixl« oo. 
15. Burr distribution. fx) = ab x^ (1 x“) * ;a»0, b» 0, x 2 0. 
16. Pareto distribution. f(x) = ox9/, кы es, Ж» К > 0. 
17. Weibull distribution. f(x) = Xa x" ' exp (-A x"), à > 0, a > 0, с> 0. 
18. Gumbel or extreme-value distribution. 
fl) = X exp (-A(x- a) - e" 7?) ; F(x) = exp X9, la l< o, lx < o. 
19. Pearsonian System of distributions. 


dy TEAN =0, ie. ONOR EC DA ae [L = linear, Q = quadratic] 
dx Q dx a +ax+ax 


The four constants dp, a,, a», b can be expressed in terms of the first four moments of 
the density function which satisfies this differential equation. 


Exercise 3(c) 


1. Which of the following are genuine (discrete/continuous) density functions ? 


LL x0 PL 
(a) Дх) = а м (b) f&) = 4x=...-1,0,1,2.... 
0, elsewhere 0, otherwise 
sinx,—m-/2«x«T Lisin xl. — 1 al. 
с 2-1 ; d) Я) = J5lsin xl, 1 « x «7 
pe 0, _ otherwise (o e) | 0, otherwise 
-ixl -i 
кое Т AARSE ШЕКЕ << | 
(e) Дх) = | Uu cleewhere (f) Ло) = id otherwise 
ar Pati сз 


0, elsewhere 


= " in x dx (h) Ла) = He (70,12... 


0, otherwise 
[Ans. No, No, No, Yes, No, Yes, Yes, Yes] 
2. Find the value of the constant k in the following cases so that f(x) represents a valid density 


function : 
(a) Дх) = kx’, 0 €x a, a»0 (b) Дх) = 2, -kxx&k 
(с) flx)=ke™, x 30,1» 0 (d) Дх) = хе^ x>0,4>0 
(е) fix) = K(0 +x, О<а<х<Ь 
101+ х), O<x<l ^ C CPP 
( fx) = kd, 2<x<3 (8) fo)- k 1$x<2 
0, elsewhere k(3- x), 2<x<3 


[Ans. 3/a°, (3)* 2,02, (1 +a) (1+ bb -) : $] 


3. A continuous variate X follows the probability law 
Кх) = 2, O<x<1 ; fi) = 0, elsewhere. 


Exercise 3(c) 
Determine k and show that 


Р{0.2 <X <0.5} 0.117; P(X < 0.3) = 0.027 ; PX» 4 Ix» 1 ) 2 37/56. 


. Letf(x)z + „Ixl <2 ; f(x) = 0, elsewhere, Prove that 


P(X <1)= 4, P(IX|>1)=1/2, P(2X+3>5)= 1/4. 


. Show that the following are genuine p.d.f’s . 


(0 fix)=e" x20 (ii) g(x) =2e*, x20 
(iii) A(x) = (1 + 8) f(x) -—Oge(x);x20,0<0< I. 


. Mixtures of probability masses. If f and g are any two p.d.f.’s, show that af + bg is also a 


p.d.f. where a and b are non-negative constants with а + b = 1. 


. A variate X has the following p.d.f. : f(x) = kx(2 - x), 0 € x € 2. 


(a) Find k. Show that the frequency curve is symmetrical and find the axis of symmetry. 
(b) Find the equation to the cumulative distribution and sketch its form. 


. Verify that Р, (х) defined as under are c.d.f.s and obtain their correspondin p.d.f.'s 
0,x«-a 0, x«-2 
(a) F(x) = 101+ (х/а)), 1х1<а (b) F(x) = i -2<х<а 
LOS a lv xz0 


Show : P(-a/2« X < а/2) = * Show Р(1Х1<= mu 


0, x3 

ds 3€x«4 0, x 
(с) (х= 11. 4<х<5 (d) F(x)= 41x. О<х<1 

A Ix <6 [eg х), xel 

l, x26 


Use f(x) to show P(3<X<5)= 1 


0, xs 
kg? gare 0 
z 2 З x«l 
= Е = -y 
(e) F(x) 1- XI - 3,1 «x«l (f) F(x) жез w 
Ё wt 
Show P(X = 024 and P(X 2 0) = 1. 
wee xd ES 
A 2. dale flex)e o x20 
de аач (h) F(x) n T 


(i) F(x) = —oo < x < v. Find points where F'(x) = f(x) = 0 


;* DUE. 201 +151" 
[Ans. (а) 01-а, а), (Б) 0) = Д-2) = +. (с) f 260 = 1, f(4) = 85) = 2 
(d) fx) = tHon +227" Кл, (е) Ах) = 2х1, гу+6(1-х) дар 


(f) Ах) = 3,х=0, Ах) = Те“, х>0 
(g) Aix) = пх, 0<x< 1, (h) f(x) =xe™, x > 0]. 
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10. 


11. 


12. 


(a) The logistic distribution is defined by the c.d.f. 

F(x) s [Leet my! ; cxa a> 0, «b « 

Show that : f(x) = aF(x) [1 =. FQ]. | ANN 

(b) Show that F(x) = (1 + ey axle o isac.d.f. ofar.v. X. Find the p.d.f. of X and show that 
it is symmetric about x = 0. 


Find the distribution function Fy(x) for the density function : 
| се-3 

i гае ] 
(a) Дх) = n x=0, Le (b) Дх) = ts x=0 

0, otherwise n "TT 

lI/(b-a,a«x«b х1 
с) = а X) m«4 
fo) R otherwise tn Н otherwise 
Show : P(-4 <X<5)= 135 

І à 

2, -1<х<0 s O0<x<l 
(е) Ax)= 442-4), 0<x<2 ( Дх) = {2-х,0<х<2 

0, elsewhere 0, elsewhere 


Show: P(-1«xs1) = 5; Р(Х> 1) = $; Р(Х>-1<1Х<1) = $. 


0, х<-а 
(a+ х)/а?,-а<х<0 
(a-x)/a’, О<х<а 
0, x2a 


(g) Лх) = 


[Ans. (а) F(x) = 0 (x < 0) + (1) Ig +02) Ina) + Hp sy. 

(b) F(x) 20I(x < 3) + 11(-38 x «0) € 2 0€ x « 4) & 11(x 2 4). 

(c) F(x) 20 (x «a) + [G – a(b — a)] Га €x « b) +1. (xz b). 

(d) F(x) = 1(х<—1)+1(х+1)(2+х-— х?) (—1< х<1)+1[(х > D. 

(е) Fo) = 01(х<-1)+7(1+х)1(-1<х<0у)у+5+1х(1-—1х)(0<х<2)у+1(х>2). 
(f) Fix) = 01(х<0)+1х°1(0<х<1у+[ +1 (х—1)у(3— ху]1(1< x«2) +10022). 


J 2 Be 
(g) F(x) = 0 I(x «-a) + 5; (a+ x) l(-a« x «0)«1a *(a – xy? ЦО <x « a) « 11 (x 2a). 


Show that f(x) specified as under is not a p.d.f. for any value of К 21-5, 
2<х<3; Дх) = 0, elsewhere. y of the constant а: f(x) = Зах -4x 


The mileage X in thousands of miles whi . i E. 
with p. E ich car owners get with certain kind of tyre is à variate 


fo) = (1/20) e .. (у. 

E t х) = 0, ? 

Find the probabilities that one of these tyres will last : "m "Es 
(a) At least 30,000 miles. (b) At most 10,000 miles 
(c) Anywhere from 16000 to 24000 miles, ' 


13. 


14. 


15 


16. 


17. 


18. 
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A country filling station is supplied with gasoline once а week. Its weekly volume X of sales 
in thousands of gallons is distributed by f(x) = 5(1 x)’, 0< x < 1. Prove that the capacity о! 
its tank, in order that the probability that its supply will be exhausted in a given week shall 
be 0.01, is [1 – (0.01)/] thousand of gallons. 
A bombing plane carrying three bombs flies directly above a rail-road track. If a bomb falls 
within 40 feet of track, the track will be sufficiently damaged to disrupt the traffic. Within a 
certain bomb site the points of impact of a bomb have the p.d.f. 


Exercise 3(c) 


(100 + x)/10,000, - 100 < x €0 
fix) = 4000 ~ x)/ 10,000, 0<х< 100 
0, elsewhere 


where x represents the vertical deviation (in feet) from the aiming point, which is the track in 
this case. Find the distribution function. If all the bombs are used what is the chance that the 
track will be damaged ? 
For a certain machine, the time X from restart after a service to next breakdown, is a variate 
with p.d.f. f(x) = 2/(1 + xy, x20; f(x) 2 0, elsewhere. 
Such a machine is routinely inspected at time г after a restart and is found to have broken 
down already. What is the chance that it has been out of action for at least time kt (0 < k« 1)? 
Another machine of the same type is found to be operating at time г after restart due to have 
broken down by the end of a further time t. What is the chance that it has been out of action 
I-[I-0-0]? — 0«20?-(«-Q-01^7 
meld Tema ру. quy? 
Time (in minutes) that a person has to wait at a certain station for a train is found to have the 
CA. ЕО) =0;0rxv< 0; P(xye'W2,0 <х< 1. 


for at least time kt (0 « k< 1) ? С р = 


F(x)= 1, 1<х<2; Р(х) =х/4, 25х<4, F(x)=l, x24. 

(а) Is the c.d.f. continuous ? If so, find the formula for its р.а. Ё. 

(b) Show that the chance that a person will have to wait (1) more than 3 minutes is 1 , (ii) less 
than 3 minutes is +, (iii) between 1 and 3 minutes is L, 


(c) Show that the conditional probability that a person will have to wait for a train for 


(i) more than 3 minutes given that it is more than | minutes is i. 


(ii) less than 3 minutes, given that it is more than | minute is t. 
The length of life X (in hours) of a certain type of light bulb may be supposed to be a 
continuous variate with p.d.f. f(x) = alx^, 1500 < x < 2500 ; f(x) 2 0 elsewhere. 
Determine the constant a and the distribution function X. Also find 

P (1800 < X < 2000}, P(1700 < X < 1900) 1 1500 < X < 2000)}. 
A batch of small calibre ammunition is accepted as satisfactory if none of a sample of 5 shots 
falls more than 2 feet from the centre of the target at a given range. The distance from the p 
centre of the target to a given impact point, denoted by variate R, has the p.d.f., fr) = 2kre a 
0 < r € 3. Find the constant k and show that the probability that a given batch will be 
acceptedis [(1 — € 1 — е). 


k А ге 
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19. Aa) If x > 20, the probability that a man aged х marries а! time г from the present time 15 
15 dt/(t + xy. Show that P (person aged 20 eventually marries} = 4 
(b) The probability that a person will die in the time interval (f,, £5) is given by 


P(t; St<t) = f, (od. 


The function f(t) is determined from long records and is given by 

fit) = kr! (100 — 7, 0 « t « 100 ; flr) = 0, elsewhere. 
Show that the probability that a person will die between the ages of 60 and 70 assuming that 
he lived to be 60 is 0.486. 


Sf n. Let X be continuous with c.d.f. F and p.d.f. f. Show that Ү = X? is also continuous and relate f, 
and F, to F and f. 


21. A continuous г.у. X has a differentiable c.d.f. F(x) satisfying : 
(a) F(x) 20, forx < 0. (b) 0 < F(x) < 1, for0 «x« I. (с) FG) = 1, for x2 1. 
Show that the polynomial p.d.f. f(x) for X, which has lowest degree is 
fix) = 6x(1-x), 0<х<1; fx) = 0, elsewhere. 


3-70. Determination of the p.m.f. or p.d.f. of a Function of a Single r.v. 

(i) Let X and Y be discrete r.vs., such that Y = g(X). Then p.m.f. of Y is given by 
ho) = X, fie». А = {х: g(x) =y}. 

Proof. f(y) = P{Y = y} = P(g(X) = y) = 2, Р(Х =x) = E, f,Q) 

Illustration. Find p.m.f. of Y = g(X), where 

(a) Y =—X, (b) Y = sign X, (c) Y = max(0, X), (d) Y = max (0, -CXj, (e) Y 21 X I. 


Solution. (a) fy(x) = fy(-x) Y= xm] 
(b) fix) 2E, ЛО); х= 1, A = (х> 0] Y =sign X = X/i X1,X + 0 
ЛАН; x20 Y=0,X=0 


Ej x = =f, 0): 
(c) £6) = ЛО), x»0 


LS) х = 0, A = {x < 0) max (0, X) = X* 
(d) f(x) = ЛО) :х> 0 
E,fj09;x-0 max (0, -X) 2 X^ 
(e) f(x) = f(x) + f(-x), x#0 Р ИРЕ a 
Р(х), х = 0 


(ii) Let Y = g(X), so that we need the density f(y) of Y in terms of the density f) of X. 
We assume that X is of continuous type and g(x) is continuous and it does not equal a 
constant over any interval. This means that, for a given y, the equation y = g(x) has а! 
most a countable number of roots Х|, X», X4, =. 


3-11. Fundamental Formula 


_. are all real roots of y = g(x), [y = g(x,) = g(x,) = ...], then the density 


* 
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§3-72. Applications of Fundamental Formula EO kA 


If for a certain у, the equation y = g(x) has no real root, then f(y) = О. 


Proof. To simplify the matter, assume that for the given y, the equation y = g(x) has 
three roots x,, x», x,. Then 

fy) dy = P{y< Y « y + dy), dy > 0. 
Thus to find f(y), it suffices to find all values of x such that y < g(x} < y + dy. And this 
is true for (see Fig. ) the following : 
A, ={x,<X<x, t dx], А, = {x, + dx, « X«x,], A, = {x,<X <x, + dx} where dx, > 0, 
ps 1,2, 3 Hence 
Ply<Y<y+dy} = P(A, UA, U A9 = P(A,) + P(A) + P(A,), [Shaded area shown] 
Now: P(A,) = P(x, <X <x, + dx) = бх) ах. P(A,) = fex) | ах, |, P(A4) = fy(x4) dx,. 
And g'(x) dx, = dy, i = 1, 2, 3. Thus, 

fx Qu) fx). fx) gy 
usb ксл Tp. P 


The result (1) now follows from the extension of this case. 


3-72. Applications of Fundamental Formula 

(1) Let Y = g(X) = aX + b. (Linear From) 

Here y = ax + b > x = (y – b)/a, for all y (single solution), g'(x) = a. Hence 
Љу) = (lal)-1f, by — bla]. 


Illustration. If X is uniformly distributed over [x,, x], then 


ЖАА) = (а: — xi Hy < x «xy f(x) = 0, otherwise [x = (y - b)/a] 
Hence, Y is U(ax, + b, ax, + b). 
(2) Y = g(X) = a/X, (Hyperbolic form) 
Here у = a/x, i.e. x = aly, V y (single solution). Since | g'(x) 1 = alx? | y? al, the density 

LM a 
"dads Iy,l ДЕ ) 
Illustration. If X has a Cauchy distribution, defined by 
Дх) = 2 (—оо, оо) (b > 0 : parameter) 


a(x" +b?) 


lal b 1 laVbn Thus Y ~ Chy (0,la | 
^ Sa a y d B b) 
Y-aX => fA» уп b«(aly! y *(alby 


(3) Let Y = g(X) = ах? (Square Form : Parabola) 
Here y = ax 50 х = + (у/а)'? V у> 0 (two solutions) 


g'(x) = 2a x, so that g'(x) = 2ax, = 2Jay ,g 0) = -2 ay. 


„ fh) = Qa" Us Ioa)? + f-Q/a71). y» 0. If y < 0, then, fj) = 0. 
The distribution function F,(y) is given by 


Fy) = PLY < у}= Р{—/уГа « X < [yl a) - F(qy/a) - FC» a). 
Exercise. Find the density of Y = X2, when X is (а) N(u, с”), (b) Lap (A ; a) and (c) Chy 
(a, b). 
(4) Y= g(X) = a tan x, а> 0. 
Here y = a tan x > x, = tan (yla), n = ...., -1, 0, baa 
Obviously, y = a tan x has infinitely many solutions for an y. Now 
2'(х) = а sec x = а(1 + tan? x) = (а? + y ya 


a лг. 


a+y n=-0 


Illustration. Let X have the p.d.f. f(x) = 1x. Now only two terms in the above equation 
are different from zero. Hence 
1 1 


E a EE ME Ал, АЙА: 
МУ) = а + у? (+2) day. [Y ~ Chy (0, a)] 


3-73. Worked-out Problems 


Example 1. Let f(x) = 2x, 0 < x < 1 and f(x) = 0, elsewhere, be the p.d.f. of X. Find the 
distribution function and p.d.f. of Y= JX. 


Solution. P{Y <y} = PWX <y}=P{X<y’} 


Fo) = | 2хах= O<y<1. 
This gives the distribution function of У. The p.d.f. of У is fo) = Fy) = 4у` 0 <у &!. 


Example 2. The radius Х of a particle is а variate with p.d.f = ar^ < 1. Find 
the distribution of the volume of the particle. pear ar, O<x 


Solution. The volume of the particle is V = (4/3) x X? 


е ЕИ ‚ SO we get 
v = (4/3) nx , dv = dnx dx. Also O < x < 1 


> O<v< (4/3) л. 


The p.d.f. of Vis given by (у) = f(x) а зра, MEC 
у 


= —— dene s 
4nx^ 4m' B 


g(v) = (3/47), O0<v<4n/3 ; g(v) = 0), elsewhere. 
The volume is uniformly distributed. 
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Problems with Solutions Provided at the End of the Text 
1*. Let Ү= 1 ХІапа 4 = DE Find the c.d.f. of Y and Z in terms of Fy. | 
2*. A variate X has p.d.f. f(x) = 1/2, x > 1 ; f(x) = 0, x < 1. Find the p.d.f. of е^. 
3*. Variate X has the p.d.f. f(x) = l/n (1 + x^), -œ < x < œ. Find the p.d.f. of tan | X. 


$3-74. Truncated Distributions 


Exercise 3(d) 
`1. Ifthec.d.f. and p.d.f. [i.e. Р(х) and f(x)] are known, find the distribution and density functions for 
or 
(a) 1X I, (b) {Хх +1Х 1], (с)авїп (Х+о),а>0, (d)e’, (е) ае u(x) where а, 4 »0; 


[u(x) = 1, if x20; u(x) =0, if x < O unit step function]. 
Sb If X is a random variable, let Y = h(X) when h is defined by 


b. x20 
у= s. х, ТЕБ Guy, AG)= ne et 
-b,' x«-—b d 


Show that (i) Fy) 20 (y < b) + Fy(y) (-b € y « b) + 1 (y 2 b) 
(ii) Fy) = Fy + b) y € b) + F0) K-b y «b Еу b) yz b), b»0. 


3. The p.d.f. of X is given by : f(x) = 1 -|1«x«2; f(x) = 0, otherwise. 
Find the c.d.f and p.d.f. of Y = X^. 
[Ans. Fy) -0. (y «0) 2 Jy (0 y«n «I0 Jy) Ms y<4) +1 I(yz4) 
fps iy'?mno«y«neiy'?01«y«4) 

4. Let the p.d.f. of X be f(x) = 2, -3€ x <3, and zero elsewhere. Find the p.d.f if 


у= 2Х?—3. [Ans. Fy) = (5/2 (34 y? /12}, (-3 < y < 15) ] 
5. Suppose that X has the p.d.f. 
"Ur ws re] _ JQ/9) (x -), -1«x«2 
(a) Ха) = ё elsewhere (b) Л) = | 0, elsewhere 


Find the p.d.f. of Y = 2X + 1. Find the p.d.f of Y =X’. 
6. Let f(x) = Le ,—o < x « oo. Find the p.d.f. of (i) Y=(X)', (ii) Z=1X1. 


7. The p.d.f. of a variate X is f(x) = Мх, x2 ку) = DE s 
Find the distribution of Y defined by Y= 2X, if X £2; Y= X db 
8. Let f(x) 22(1-x),0«x« I ; f(x) = 0, elsewhere. Find the distribution of Y defined by Y = 2X, 


if0<X< is ¥=S5,ifX2 i. 


3-74. Truncated Distributions 


F we remove (i.e. truncate) th 


bility function 


Ь-1. 
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Truncation to the left and to the right of x provides the characterization : 
P{Xla<X<b} = Р(х)/Р(а<Х < Б). 


. . . даш 
If f is the integrating density of a variate X, then 


(i) The p.d.f. of X Truncated to the left of X = a is 


g(x) = 0, х<а; g(x)= LR x » d. 


(ii) The p.d.f. of X, Truncated to the left at x = a and Truncated to the right at x = b 


р(х) = О пакод РОМ" р) а EN а<х <. 
(iii) Some frequently used truncated distributions are bin (n, p), pois(A), gem(p), 
N (р, 0°), expo(A), etc. 
Example: If, f(x) = ra‘, x = 0, 1, 2, ..., and if X is truncated to the right of X = k, such 
that POI X < k — 1} is approximately 2Р(0), find a suitable value of k. 
Solution. By Normalization : 1 = Xf(x) = A(1 a + a +...) 2 МІ — a), hence А = (1 – а). Now 


P(X <k-1) = @ Y a* - (1— у. 
PLI 
mn AES ue oM 
P(XIXSk-1) = рр ТИР 
So P(OIX<k-1) = (1—ay(1 - a5. 


P(OIX<k-1}=2P0) = (1-а) –- а) = 2(1-а) >а = 1 = k= (In1)/lna 


3-80. Miscellaneous Worked-out Problems 
Example 1. Let f(x) = x^^ '/{B(a, b)(1 + ptah ;a>0,b>0 O0>x<0 
Find the distribution of Y = 1/(1 + X). 


Solution. Here y = 1/(1 + x); and obviously, y is decreasing function (since x increases 
from 0 to oo) and it decreases from | to 0. Now, | 


(dyldx) 2-(1 + x)? > ах = -у° dy. Аіѕоу= (1 +x)! = x4 (1 — y)/y. 


х) dx = l [= Lx a аат 
д) _В(а,Ь)` y y MEE д). 
Reverting the support, hence ЖОРО ы sign, we recover, 
(у) = у 01 у)“ Bla, b) 0 « y « 1. 
Remark. The p.d.fs. of X and Y are known as beta-distributions of the second kind 
and first kind respectively. 
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Miscellaneous Exercises 
Example 2. If f(x) = € ^, x > 0, X > 0, find the distribution of Y = X/(1 + X). 


ECTS — x= У аак. 1 cec) 
l+x 1-y' dy (1— у)? 


Solution. Here y — 


Since у’ > 0, it follows that y is an increasing function. Now, from (1) 
x£025y-20,x—5o yl. 
fy) = UG) | dxldyl), = 1e ^" + y, O< y « 1. 
Note. Distribution Function Method is also convenient. 


Problems with Solutions Provided at the End of the Text 


/Á*. If the graph of a p.d.f. of a variate X is an equilateral triangle of side-length a, 
find the value of a. 
2*. The p.d.f. of a variate X is P(X = k) = (1/2) ; К = 1, 2, ... Find the distribution of 
re sim (tX/2). 


3*. Variate X has the p.d.f. Дх) = Ит, =I <x SAn. Find the p.d.f of Y = sin X. 
4*. Variate X has the p.d.f. f(x) = 1, Oxx« 1. Find the p.d.f. of Y= ех, 
Miscellaneous Exercises 


ra. inm X is a variate whose p.d.f. is given by | 
= (x + 2)/3, p, = (2х + 1)/4, р; = (1 – 10x)/12, [Py= Р(Х = x)]. 


Determine for what value of x the above is a probability function. [Ans. -i el 
2. Let X be a continuous variate with p.d.f. 

Хх) = ах, 0 <х<1, Дх) = 1,1<х<2, х) =-ax + 3a, 2 <x <3, f(x) = 0, elsewhere. 

Determine the constant а and show that P(X < 1.5) = 5 ; 


Ж 3, A discrete variate X has the p.m.f. 
P(X = x)= K/(x+ 1) (x 2), x= 1, 2, 3, ... (К: constant) 
Determine К, find c.d.f. of X and show that P(r <X <s)=2(s—r+ I)/(r+1) (s+ 2), where r, s are 
positive integers. 
М 4, Let: Fx) = 0x <0) + 3 1(0 x x« 1) +1 (x2 1). Show that 1 — [1 — FG]. isa c.p.f. on А. 
5. Show that the following functions do not represent c.d.f’s. : 


0, x«-1 
ku EM DE I-x, -Isx«i 
zin -Isx<0 ; x)= ahs 

(a) F(x) * a (b) G(x) (1) +22, tex<tl 

i. x21 

0, х<0 


(с) H(x)= 43) + x/4, 0«x«0. 
t; хэ] 
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12. 


. If the graphs of p.d.f" 1/2 


. Let X have a strictly monotonic continuo 


s of variates X and Y are square of side length a and semi-circle of radius 


Um < | 
лапа without replacement from the first 10 positive 
llest of these four numbers, show that f(x) = (x – | 


b respectively, show that a = | and b = 
Four distinct integers are chosen at randon 
integers. If the variate X is next to the sma 
(10 — x) (9 — x)/420, x = 2,3, ...., 8. 
Let X have a strictly monotonic, 
distribution of Y is U(0, 1). 

Let F bea c.d.f. of X. (i) Show that G(x) 


continuous c.d.f. F(x) and let Y = F(X). Show that the 


== ДЕХ) УхеК is also a c.d.f., (i1) g is the c.d.f. of -X 
us c.d.f. F(x), and let G(x) be strictly monotonic. 


continuous c.d.f. Show that G^ (F(x)) has G(X) as its c.d.f. 


. Variate X has c.d.f. F(x) = exp ете Show that the distribution of 


Y = exp [-(X - a)/B] is 0) = e^, yz 0. 


{ -Ày 
If f(x) = 2Axe ^" , x20, show that the density of Y= Ж is g(y) 2 Ae ^, y? 0. 


13. If fix) = (1 + 3)/2, -1 <x € 1, show that the density of Y= X is g(y) = + Jy, < у< 1. 
ju уіне X has the exponential distribution : F(x) = 1 - e*,x20; Рух) 20, x «0. Let Y z X if 


15: 


a. 


18. 


. Show that if F(t) is a c.d.f. and if G(t) = 1 — F(t) satisfies the Cauchy equation G(x + у)=6 


Х<2; Y=1/X, if X > 2. Find the distribution of У. 
[Ans. F(t) 20 (r € 0 + [1 ее 0<t<t)+[1- e" +e°]I@Œ<t<2)+11(t>2) 
The length of time X (measured in days) that a gadget lasts obeys the p.d.f : 

fix) =2e™, x>0 ; fx) = 0, elsewhere. 
If the gadget lasts more than 3 days the profit is Rs. 10 ; otherwise it incurs a loss of Rs. 20. 
Find the distribution of the profit Y. [Ans. P(Y = 10) = r$ P(Y = -20) = |- е“) 
A coin is thrown. If is lands head, a second coin with faces marked 1 and 2 is thrown. If the first 
coin shows tails then a point is selected at random from the unit interval [O, 1]. If X denotes 
the number that appears as the final result of the experiment, find c.d.f. of X. 


. A variate X has the c.d.f. ‘F : F(x)  pH(x) + (1 - p).GQ), (0 « p < 1, p € R) 


where H(x) 2x, 0«x«1; H(x)21,x21, G(x) = txy0<x<2 G(x) = 1, х> 2. 
Sketch the graph of F(x) for p = 1 . Give a formula for the p.d.f. of X or the discrete density of 
X. Also evaluate P(X € 11 X <1}. 


A variate X has the c.d f. : 
0, x«0 
2 
uide +02, 08 x «05 
PEUT s (eter 
А bi! 


(a) Show that F is partly continuous and partly discrete aad sketch the graph of Р(х). 

(b) Express F,(x) in terms of indicator functions. 

(c) Decompose F(x) in the form : pF (x) + (1 — p) F (x). 

(d) Evaluate P(0.25 « X « 0.75) and P(0.25 « X « 0.50). 

(x) 
G(y), V x, y Z0, then either F(t) is degenerate at zero or F(t) = 1-е, а> 0,120. 

Let X be non-negative r.v. with P(X > 0) = 1. Deduce that if 

Р(Х>х+1(Х> 1) = Р(Х> x), V «20,120, then Еу) = 1-е“ а> 0,120. 


Conduct is wise or foolish only in reference to its results. 


нчен еее 


Each venture is a new beginning to explore something hidden. 


Appendix : 


Mixed Distributions 


Definition. Let X be a r.v. with distribution function F. If F(x) can be decomposed as 
F(x) = pF (х) + (1 -p) F, (х), 0< p<! AX) 

where Р, is the c.d.f. of some discrete variate and F is the c.d.f. of some continuous 

variate (F, is absolutely continuous), then F is called mixed distribution function. 

The definition implies that F is partly continuous and partly discrete, i.e. F is neither 

continuous nor discrete. 

Comments. The density function f(x) corresponding to F(x) can be defined by 
fozpf(o-*-(0-p)fQ) V: discrete density, f, : abs. continuous density] ...(2) 

The definition (2) is more involved; hence we would prefer using (1). 

Remarks. In general, it can be proved that any distribution function F can be 

decomposed in the form 


F(x) = р,ЕДХ) + poF (x) + p4 Fx) 
where 0 <p,, p, ру < 1; р +р +рз = 1. 
F is ће c.d.f. of some discrete variate, Е. is the c.d.f. of some absolutely continuous 
variate and F, is the singular distribution function. 
The proof of this result is beyond the scope of this book. We now present two illustrations 
for mixed distributions. 
Example C-1. F is a c.d.f. on R defined as 


0, x«0 
l O<x<+ 
TELS 2. 
ГОА x - (1), T&x«] 
l; x1 
Show that it is neither discrete nor continuous. 0 U2 


Solution. The graph of F is shown in the figure above ; since it is not a staircase (step 
function), it is not discrete. It is neither continuous because it has jumps (discontinuties) 
at x = 0 and at x = 1. Obviously. 

P(X = 1) = F(1)- FU - 0) = 1 -(1- 4) = 1. РОХ = 0) = F0) - F0 = 1 -07 4. 


In fact F(x) = 1 F,(x) + 1 F), where 


0, x<0 0, xst 
Ех) = 43, 05х<1; F(x) = 12x- 1, і<х<1, 
low L x21 
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Example C-2. A random variable X has the c.d.f. ‘F’ 


0, х<0 
i xz0 

dad: (D) 3), 0«x«1 
I t21 


Show that f is neither continuous nor discontinuous. : 
0 X= x 


Also evaluate P(0 < X < 1). 


Solution. The graph of F is shown in the figure above. Since it is not à stair case (step 
function), it is not discrete. It is neither continuous because it has jump (discontinuity) 


at x = 0. Now 


P(X =0) = F(0)- F(0-0) = 1-0-1. 


We can also decompose : F(x) = + F,(x) + + F.(x), 


SO 0, x<0 
where Fx) = 5x, 0<х<1; ко |0 nor i 
15 vez] Eo n 
Р(0<Х< 1) = F(l)-F()«P(X-0)-(1-1)-141-3. 


Note. F (x) is the d.f. of the variate Degenerate at x = 0. 
Some Exercises 
Note. Indicator Form : F(x) = g(x) (а < x <b) + h(x) I(c < x < d) means: 
F(x) = g(x), a<x<b; F(x)=h(x),c<x<d,etc. 
1 A random variable X has the c.d.f. F 
F(x)21 ре, x » 0, A0;0«p«tTiF(X)s0,r X0. 
Decompose F(x) in the form pF (x) + (1— p) F (x), where Fis the d.f. of a continuous variate 
and Fis the d.f. of a discrete variate. Find P(X > 2), P(X < 0) and P(X = 0). 


2. A random variable X has the c.d.f. Е” 
F(x) =01(х<0)+ lx €) 0s x «1 - 10(x2 1. 
Show that F is neither continuous nor discrete. Prove that 
Р(Х == 1 and P(-3< X< ijs p 
3. A random variable X has the c.d.f. ‘F’ 
F(x)= 01(x <0)+ 7510S x «3 exile x «lll» n. 
Show that F is neither continuous nor discrete. Decompose F(x) in the form 
pF (x) + (1 - p) Fx), 0 <р < 1.5һом further: РОЗ «X «1)- 1. 
4. Let the distribution function, ‘F’ in the indicator form Бе: 
F(x) :01(x«-1)* (х +2) (—1< х<1)+1(х> 1). 
Sketch the graph of F(x) and write it as pF (x) + (1 — p) F (x), 0 <р<1. 


P | Ехетсїзе | al ЫР Р uum TL 
Evaluate: P(- 4 «X s-1), Р(Х = 0), P(2<x< 3). 
. ÀA random variable X has the c.d.f. F 
F(x) 0, x«0; F(x)=1-(4y'*!~ (Lt!) 59. 


Show that F is neither continuous nor discrete. Sketch the graph of F(x) and decompose it as 
pF (x) + (1 — p) F(x). Also show that, 


P(1 <X $3.5) = (7/16) - (0/42)? ; Р(1.5<Х «45) (7/32) – (1/ 2)! - (0/ 42)? ; 


Р(1<Х<4) = 13/32. 
TY random variable X has the mixed c.d.f. 
F(x) =0 I(x «-1) - (x +2) /(—1<х=< 1) * 1 /(х> 1). 


Given that P(X = 1) = Ф ‚ find K. Sketch the graph of F(x) and decompose it as pF (х) + (1 — p) 
F (x). Determine : Р(Х = –1), Р(-1<Х < 1), P(ÓXI« 1), Р(Х > 4 |X > +) 

. A random variable X, as the c.d.f. F in the indicator form : 

F(x) = 0I(x «0) + 3x 0S x «) e dx (18x «2)11(xz2). 

Sketch the graph of F(x) and decompose it as pF (х) + (1 — p) F(x). Also evaluate 

P(t sXs +), P(4<X<1). PCL <Х<1),Р(1<Х<2). 

. A variate X has the c.d.f. F, expressed in indicator form : 

F(x) 01(x«0) + xI(0s x «1)« 2 Ii&x« 1) + [(x/8) + (6/8)] 1 E x € 2) + 1 I(x 22). 


Show that F is neither continuous nor discrete. Sketch the graph of F(x) and decompose it as 
pF (x) + (1 — p) F(x). Also show that, 


P(X= з) = iiP(05«Xs15)9 $ i P(EeXs 2) 1; POCO 31X $15) - 1. 


And of all axioms this shall win the prize 
It’s better to be fortunate than wise. (John Webster) 
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The power of imagination makes us infinite. (John Muir) 


Jointly Distributed 


Random Variables 


4-00. Introduction 


When the outcome of a random experiment can be characterized in more than one 
way, the probability density is a function of more than one variate. For example, 
when a card is drawn from an ordinary deck, it may be characterized according to its 
suit and to its denomination. Let X be a variate that assumes the values 1, 2, 3, 4 which 
correspond to suit in some order (say Clubs, Diamonds, Hearts, Spades) and Y be a 
variate that assumes the values 1, 2, ..., 13 which correspond to the denominations : 
moe. 2,3, 15"10, J, О, Ki Then (X, y is a 2-dimensional variate. The probability of 
drawing a particular card will be denoted by f(x, y) and if each card is equi-probable 
of being drawn, the density of (X, Y) is 

Pryor 5285 S 3684; Lis 0$ 13. 
Trials whose outcomes can be characterized by two (three) variates give rise to bivariate 
(tri-variate) distributions, etc. 


Extensions to n-variate distributions are fairly straight-forward. 


4-10. Two Dimensional Random Vector (2-dim r.v.) 
Definition. Let (Q, F, P) be probability pace and consider two functions X : О ә К 
and Y : Q — R. Then vector (X, Y) is a function : 
(X, Y) : О —> R x R defined by (X, Y) (о) = [X(@), Y(@)], V o e О. 
A vector (X, Y) is called a 2-dimensional random vector iff {@ : X(@) < х, Y(o) € y) EF, 
for all real numbers x and y. 
Note. n-dimensional random vector (X,, X,, ..., X,) is similarly defined : 
(X, X5, ., X) | О ә R'isarv.iff (X, Sx, -. MAT. 
where, as usual, we ee АДАД s pas € x, Қо) sy} = (X x, Y € y], etc. 
Theorem. The vectc ^) is a random x ector on a probability space (О, F, P) iff X. 
and Y are random отте оп п (0, Р, Pj 
Proof. Let (X, Y) Бе a random vecti t on the probability space (О, F, P). Then, by 
definition, 
(Xzx,Y$y] eJ, Vx y e R. 
In particular, (X < x, Y « o») € F. But (X <x, Y< oo) = (X <x} reo) = (X sx) iQ = {Xs} 
{X<xJe F, Vx eR > xis ar.v. оп (О, F, P). 
Similarly, Y is also a r.v. on (Q, F, P). 
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Conversely. Let X and Y be variates on (Q, F, P) and x, y be any two real numbers. Then, 

by definition, (X <x} € F, V x € R;{Y<y} є 7, V y e К. By the nature of o-field 7: 
(Хх) П ({У<Уу) e У, і.е. (Х<х, Y<y) EF, Vx, y e К. 

This proves that (X, Y) is a random vector. 


4-11. Joint Distribution Function and its Properties 
Let (X, Y) be a random vector on the probability space (О, F, P). The joint c.d.f of X 
and Y is denoted by F, , and is defined by 
Fy убх, у) = P(X <x, Y<y), Vx ує К. 
Note. The individual c.d.fs. of X and Y shall be denoted by Fy, (ог F,), and Fy (ог Р.) 
and Fy у shall be simply written as F. 
A joint. c.d.f. of two variates has the following properties : 
1. Non-negativity and Boundedness : 0 € F(x, y) € 1, 
Vx,yeR. 
Proof. F(x, у) = Р(Х <x, Ү<у), Ух, у є К. 
As probability measure is non-negative апа 0 < Р(Х < x, 
Y € y) € 1, hence (1) follows : 
2. Monotonicity : The c.d.f ‘F’ is monotonicall non- 
decreasing function in each of the individual variable S, i.e. 
(i) Ка, У) S F(a, yj). if y, 2 yi 
Cii) b) 2 Fx, Р), if x, 2 3. 
Proof. Observe the equivalent events 
{X<a,Y<y,} = {Xsa,Y¥sy,} U {Х<а, у <Ү<у,). 
Taking probability of both sides, using finite-additivity : 
P{X <a, Ү<у,} = P{X<a,Y<y,}+P{X<a,y,<YVsy,} 
ог P{X<a,y,<Ysy,}= F(a, у,) - F(a, y,). ET) 
Since ‘P’ is non-negative measure, this readily gives : F(a, y,) > F(a, yı). 
We can similarly establish (ii). 
Cor. P(X <a, c < Y<d)= F(a, d) - Ка, с) (а> с) [by (1)] 22 
Let a, b, c, d be any real numbers with a « b and c « d. Then. 


Xsbcersd = FO d) + F(a, c) — F(b, c) – F(a, d). 


Proof. We define the events: A = (X <a}, B= (X <b}, C={Y¥<c},D={Y< 
Pla<Xsb,c<¥sd}=P{(B-A)(\(D-©} =P{BN (D-C)-AN(D-O)} 


= P(B(1(D- C) - PIA (D С)) iv AC B] 
= РВПр- ВПС) –- РАП р- АПС) 
= [P(B f| D) - Р(В Г\ С)] – [Р(А П D) -PAN D)] dedit ey 


-P(Xsb,Ysd)-P(Xsb,Ysc)-P(Xsa,Yxd) + PX <a, Y < с) 
= F(b, d) — F(b, c) - F(a, d) + F(a, c). 
4. Individual Limits : (i) lim F(x, y) = F(-,y) 20; (ii) lim F(x, у) = F(x, - %ю) - 0. 


Proof. (i) Let (х,) be any decreasing sequence of real numbers such that lim x, = —o as 
n — о. Then the sequence of sets A, = (X < х, Y < у} is a decreasing sequence and hence 
lit Aja А 
noo A 
lim Р(х, У) = lim P(X < x, Y < y) = lim P(A,) = P(lim A,) = P(2) -0 


ЯР n—»o 


as P is a continuous measure. Thus, by the notation set-out F(—», у) = 0. Similarly, F(x, —) = 0 


5. Double Limit: lim F(x,y) = 1, i.e. F(o, ә) = 1 (Formally). 


x>. ү 
Proof. Let (x,) and (y,) be two increasing sequences of real numbers such that 


lim x, = +, іт у= + о 
n oo noo 


Then, the sequence of set A, = (X < x,, Y < у, } is an increasing sequence and so 


lim A, = JA, =. 


oo 
n Tw) 


lim F(x,,y,) = lim P(Xsx,,Ysy,)= lim Р(А,) = P(lim А) = P(Q)=1. 


n>% п oo 


[P is a continuous function] 


Thus, the stated double limit (5) holds. 
г We or t oiam Fl, ») zur АС Ds = a 


= ER eee ee Oe бу. a 
P De 34 Wt Y 
1n асп iS. 1 ET 


p. 


a i Let (x,) be an increasing sequence of real numbers such that x, » a and 
lim x, = a. Then, the sequence of sets A, = (X < x,, Y < y} isa decreasing sequence and so 


lin A, = ПА, ={X<a,Y<y}. 


п oo n=l 
Using continuity of measure P we 'have 
lim F(x,, y) = lim P(X € "E, « y) =: lim P(A,) = P(lim А,) = P(X <а,Ү < у) = F(a, у). 
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Thus lim F(x,y) = F(a, у). Proof of (ii) is exactly similar. 


Consistency Relationship : 
P(X < x, no condition on Y} = 
In particular, Fy у (x, oo) = Fy(x), Fy y(™, у) = FY). 
7. P(X =a, Y = b) = Fla, b) + Fa, b.) - Fla, b)- Еа , Б) W 


Еубх), P {No condition on X, Y < y) = Fo». 


here F(a’, b) = dum F(x, b), etc. 


Proof. Let us consider the sequence of sets : 
Aye (а- п)! <X<a,b-n'<Y<sb 
Then, this sequence (A,) of sets is a decreasing sequence and so 


lim A, = ЙА, -(X a Y =b} 


n oo nzl 


Using continuity of measure P and the Rectangle Rule, we have 


1 
кт А,)= lim P(A,) = ит P(a- 1X sab «Y <b) 


тє [К{а-1Ъ»-1)+ Ein: Б) Ңа-1.ь)- F(ab- D) 
n n n n 


F(a, b) + F(a, b) - F(a , b) - F(a, b) 
as the sequences (a — n') and (b – n^) are increasing and satisfy a — n'«a,b- п <b; 
lim (a — n) = а, lim (b- п!) = р. 

8. Survival Relation : Fy у (а, b) – Fy(a) – Fy(b) = P(X » a, Y » b) - 1. 
Proof. Define the survival functions A = (X > a}, B = (Y > b} so that A ={X<a}, В ={Y<)}. 
F(a, b) = P(X <a, Y < b) = P(A B)-1- P(AUB) =1- P(A) - P(B) + P(AB) 

= Р(А) + P(B) + P(AB) – 1 = Б; (a) + F,(b) + P(X >a,Y > b)- 1. 
Remarks. If Е is x-continuous, then F(a, b) = F(a , b) as also, F(a, b.) = F(a’, b`) and 
thus P(X = a, Y = b) = 0. Similarly if F is y-continuous, PX = а, Y = b) = 0 Thus to 
locate the points (x, y) where P(X = x, Y = y) > 0, we need con id : 
where F is discontinuous in both variables. NL ee pons 


he 


> ғ р, ee PIE ms 
bivariate c.d.f. 


Р(Х «ia, Xm i) 


[Ру уб, y) = FG, у)] 


2. If x, € x, and y, < yz, then 
F(x у) S Еб, y) S FG, у); F(x,, «F 
3, lim Wr he Pb e] TR (х1, y) < F(x, у,) 


Y— 90 


4. lim F(x, у) = F(-, y) =0; lim F(x, y) = F(x, – оо) - 0 

. lim F(x, y) = F(a’, y) = F(a, у); ET | 1 

. FlaaeXsb,Ysy)-F(by-F(ay; P{Xs А, 

7. Ifa<b,c<d, then X c«ysd)- F(x, d) - F(x) 


P(a < X <b, c <Y <d} = F(b, d) + F(a, с) – F(a, d) — F(b, с). 
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$4-12. Worked-out Problems 


4-12. Worked-out Problems 
Example 1. Functions G(x, y) and H(x, y) of two variates X, Y are defined by (i) G(x, y) 
=1,ifx+y20; G(x, y) = 0 if x + y «O. (ii) H(x, y) = 1, if x > y, H(x, y) = 0, if x < у. 
Examine whether G and H can be the distribution functions of some 2-dimensional 
distributions. 
Solution. (i) Function G(x, y) is a c.d.f. if Rectangle Rule holds. Now 
P(a«Xsb,c«Ysd) = G(b, d) + Gla, c) - Ga, d) - G(b, c). 
mete As 0, 0< Y= у= 6(0,1)-6G(-1,0-GC-1,1)-G(0,021*40-1-1-2-1. 
Since the probability measure turns out to be negative, the function С cannot be a c.d f. 
(ii) We choose a « c « b « d and use Rectangle Rule : 
P(a«Xsb,c«Ysd) = H(a,c) + H(b, d) - Hb, c) – Haad) =0+0-1-0=-1. 
Since the probability measure is to be non-negative, H(x, y) in not a c.d.f. 
Example 2. If X and Y have a joint c.d.f. F, show that 

Ех) + F4) — 1 < F(x, y) < [F\(x) Fx)", V x, y. 
Solution. Let A = {X <x}, B= (Yx y) ;thenA(| Bz2 (X <x, Y € y). 

АПВсА = Р(АВ) x P(A); like wise P(AB) < P(B), hence 

ШОНУ s P(A) P(B) => (F(x, у)] < FG) : F4) = FG, y) < [F\@) - F0] 

P(A U B) = P(A) Р(В) - Р(АВ) > P(AB) SPA) + P(B)-1-[^ P(A U B) < 1] ...(2) 
. RUD УУ ЖЕ, (+ F,(y) — 1. 
алшак (1) and (2) we get F,(x) + FXy) — 1 < FQ, y) < [Е|(х) F,0)] 


Problems with Solutions Provided at the End of the Text 


NS Sh) 


fe 


1*. The joint c.d.f. of X and Y is given by 


0, Xx«—2 ot y«-5 
1, -2<x<2, and -5<y<3 


F(x, y) = 205 x< 2 and 5 у «37 
P '—2S$x*2, and y23 
1 x22, and y23 


Find P(X = -2, Y = —5), P(X =-2, Y = 3), P(X = 2, Y 2 –5), Р(Х = 2, Y = 3). 


a. Show that the bivariate function 
G(x, y) 21-67? ,x»0,y21; GG, у) = 5 
distribution function although its marginals are distribution functions. 


3*. Find the chance that a point (X, Y) hits the region: 1 «X «2, 1 «y x2 if 
F(x, у) 206, x «0, y <0. 


osses the same 


(1-е), х> 0, 0 < у < 1 is nota 


F(x, у) = Ре -а?” кет ux & 0 yeta; 


4*. Give examples of different bivariate distribution functions which p 
marginal distribution functions. 


Random Variables 


1M — war 
4-20. Joint Discrete Distribution Function 
Let (X, Y) be a random vector with joint c.d.f. ‘F’. Recall xu 
P(X =x, Yo y) = Fi y) + Fc, y) - Fe у 27 mu o 

Since F is a real-valued bounded function, and is monotonic in each variable, so F has 
finite or countably infinite number of points for which P(X = x, Y = y) > Os 
Definition. The joint c.d.f. of X and Y is said to be discrete if there exists a non- 
negative function p such that p vanishes everywhere except at à finite or countably 
infinite number of points in the plane and at such points (x, у), p(x, y= P(X =x, Y = y), 
x,ye R. 
Theorem. If the set of points where p does not vanish is denoted by {(x; yp tA 1, 2, 3, 

. }, then the following result holds : ~ 


(yp »)20 vij Gi) Fa у) XE Ero» Gil) X У (к, У) =1. 
Mis xp Sy tale) = 


Proof. (i) Since р(х, y) = P(X =x, Y = y), so р(х, y) > 0, since probability measure is non-negative 
(11) F(x, y) = P(X <x,¥<y)= UP(X=x,Y <y) [P is countable additive] 


X;Sx 


= У Р Р(Х=х,Ү=у,)|= € У р(х, у;) [countable additivity of P] 


FSL LASY Sr yj Sx 


(ii) 12 йт Fe, tim Y У puy)- E X роу) У X pos»). 
i .. aa Sx Jessy | ` - : "ida 
i P CD. X; <O уу <% pa) у=1 


Definition. Let X and Y have a joint discrete distribution. A function p which does not 
vanish on the set {(x;, y) ; i j = 1, 2, ...} and satisfies the properties : 


(i) р(х, ур 2 0,4, 7 = Soe: (11) 2 у Р(х, y;) =1 


j=l 
is called joint probability (mass) function of X and Y or simply the joint probabilit 
function. Often we use the term, discrete density for brevity. d 4 


4-21. Individual or Marginal Probability Functions 


Let X and Y be two jointly distributed variates with joint di 

iii A scret 
theorem ($4-10), the individual variates X and Y themselves be oed D D. 
The individual distribution of X and Y are called marginal distribution of Y ыл Y А 


(1) The marginal probability function for X is denoted mE 

(2) The marginal probability function for Y is denoted by p omm and is given by 
(00 pi) = PO ey) = E PX =x, Vey) =, р(х, y) 

Note. lt is often convenient to display the probability function of a bivariate distribution 

in a rectangular array, in which the row totals and column totals provide the marginal 

probability functions of X and Y respectively. Thus, 
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Bivariate Probability Distribution Table 


Р(У„) 
оа eH, BE ур, ра) = рр РО) = ру. 
4-22. Conditional Distributions 
Recall that if A and B are two events with P(B) > 0, then P(A | B) = P(AB)/P(B). 
Letting A = {X < x}, we get 
Р{Х<х1В) = Р{(Х< х) П B}/P(B). 


This is called the conditional distribution function of variate X given that the event B occurs. 


Conditional Probability Functions (Cond. p.f.) 


Let X and Y have a joint discrete pee with associated probability function p. 
Let the possible values of X be {x,, x,, ..., x; ...} and those of Y be [SR TM у} а 
respectively. 


The conditional probability function of X, given Y = yj notated by P. » (x; | yj, is defined by 
Ру, Gly) = Р(х, yP Oh i = 1, 2, Ba 
= 0, if PQ) = oF 
Еа probability function of Y, given X = X; notated Py, x, O; l x;) is defined by. 
Py, (y; Ix) = — уте hy 1. 34 
= 0, if Р(х) = 0. 
Recall : P(xj, yp = P(X = Xp Y= P yj = Py), and P(X = x;) = Pix). 
Theorem. Conditional probability function of X, given Y= y; is a bona-fide discrete p.f. 
Proof. (i) P(X = x, IY sy) = Р yp/PGyj) 2 0, since probability is non-negative measure. 


May) NODE 
(i) X Pte ху = ур = iT. ТЄ ry 


: i- -Rul 
Where we have used marginal density of Y = y; [Multi-stage p-Rule] 


Since Ру, (x, yj) 2 0 and У, Pxiy, Op Ур = 1, the theorem is proved. 
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Variables 
led independent if for every pair 
(Y < y} are independent ; i.e. 
IRAM 
‚ F(x, y) = Ех) Fy) Moy 
[if densities exists] ...(3) 


4-30. Independent and Dependent Random 
Definition 1. Two random variables X and Y are cal 
of real numbers x and y, the two events (X < х } and 
Р{Х<х, Y<y} = P{X<x} P(Yxy) 

Condition (1) in terms of distribution functions is 
Also : fix, у) = О) fy). 
Conversely, if (2) or (3) is true, then (1) follows. 
Definition 2. Two variates X and Y are called inde 
numbers a, b, c, d, (a « b, c « d) 

P(a « X «b, c«Yxd)- P(a< X <b) P(c «Y d). 
Definitions 1 and 2 are really equivalent. 


Dependent variates. Variates which are not independent a 
variables. 


Theorem. Let X and Y be independent variates and suppose that G(X) = g, H(Y) = h. 
Then G, H are also independent. 
We assume that G and H are defined on the respective ranges of X and Y. Then 
P{G(X)= g, HY) = Вр = DPX Зул = е С (суў = H '(h)} 

= У «Р(Х =x). P(Y =y) 

= P(G(X) = в}. P{H(Y) = h}. 
Comments. The converse result of this theorem is not true, i.e. if g(X) and A(X) are 
independent, X and Y may be dependent. See §4-70 Example 1. 


pendent, if for every choice of real 


re called dependent random 


4-31. Worked-out Problems 

Example 1. Show that marginal distributions do not determine the joint distributions 

uniquely. 

Solution. Consider an infinite family of bivariate distributions f,(x, y) defined at the 

vertices of a unit square. 

Obviously, P(X 20) = Р(Х = 1) = 5, (Y 20) = P(Y = 1) = 1 (2) 

Since P(X = x, Y = y) + Р(Х = x) P(Y = y). X and Y are dependent. Note that all the 

infinite bivariate distributions (1) [e.g. ХО, 0) = ДІ, 1) = (0,1) = ДІ, 0) = 1 : 0, 0) =fll, D 

, S s , "v , 

= 1/8, fO, 1) = fl, 9) = 3/8, etc.] possess the same marginals, the uniqueness concept 

is completely routed. 

Example 2. Let X and Y be integer-valued random variables with the joint p.m.f. 
P(X=m,Y=n)= d p" ;nim21,2,3.. (р+4= 1) 

Аге Х and У independent ? 

Solution. We use Multi-Stage Rule to get 


E ум у Арса] = “= 
P(X = т) = 2 P(X =m,Y = ])=4 Р 2-0» =? p"[ü-p)2qp"'! 
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ee у. $201. Worked-out POMERE 0 0 0 0 (7 
Р(Ү= п) = У, Р(Х =і, Ү = п) =ар"!. 
i=l 

Since P(X 2 m, Y=n) = P(X 2 m) P(Y=n), V m,n, we infer that X and Y are independent. 
Example 3. Random variables X and Y possess the joint density 

“hax pq 
ot у) 
Find the marginal and conditional distributions and evaluate P(X < 1). 


Solution. Summing out y, and using binomial expansion, the marginal probability for x is 


Є 
р(х, у) = рс 90.12... wes, 2, 3, ... 0006р. I. 


Py (x)= Ep. ys = Y gH. cad ту е Ў |= pY us (q+ p)“ 
$ | A yl-t* P ria sD "d Р "NL 
E? Ux х=0,1,2,.. V) 
Summing out x, and using exponential series, the marginal probability for y 1$ 
-À Ly 
5 ер e (№) e d r0 
p = X, z-2x- y] 
Ю) = Lp- Te уу Тл pO та y 
=. у -Àp y 
= [RD AN "a = е XM e LM Te , y—0; BP e. MY vae) 
Орач xta «(1 yox-y 
he т Pe) v цу (у) аА У R aei (3) 
NAX AY ay ! et x-y 
po ye doe ^ Pd Уз е, (4) 


Be yt. xe e Oy (x - y)! 
From (1) P(X < 1) = P(X 20) =e" А 
Example 4. The joint p.m.f. of (X, Y) is given by 


fay) = | [ Ж x20,y21, 1»1- p» Q»0. 


Determine k. Are X, Y independent ? 
Solution. Firstly, we determine k and the marginals f,(x) and f,(y). Now, 


х+у—1 
X 


2 ES +y-1 x А - _ N ntr-1 r 

Ууу) = kQ' iG М )» [Recan eT) -& ў d 

= КО? (1- p)? = 0/4), [0=1-р, P=- Q] ..() 

Y s reu мк Ж faGP. (i) 
x Efo.» - ФЕ = hig ау (Gum of a ӨР) 


By normality Èf, у) = 1, consequently 


d 1-00 Р-р) (РФ =1,р+а= 1) (iii) 
КЕЗШ, p F 
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Я ў=1 
Q 2) -123.. у (i) and (iii)] 
, — {= = l er ANC 
od | A 4 
Ло) = Ef y= kp? OE (** 7" Jo [Put y - 1 = r] 


T 
S 
© 


19. $[t+1+r-Nor= рота МДҮ, — INeg-bin Theorem 
r 


r=0 


ко (2) -( 2464 Poe e RN {Бу OO (іу) 
Р (Р PAP)' 


We conclude that X ~ gem (i -£] and Y ~ gem (i -2) 


Since f(x, y) + fi(x) hO), we conclude that X and Y are not independent. 


1”, 


е, 


4*. 


9". 


6*. 


Problems with Solutions Provided at the End of the Text 
A pair of dice is tossed. Let X be the number on the first die D, and S be the sum 
of the two faces. Determine the distribution (X, S) and show that, 
PCS. 2k) = 601/36, Rm 2723. y, 12, 
Let X and Y be the minimum and maximum respectively of the results, when two 
dice are rolled. Find the marginal p.m.f. of Y and P(X = x1 Y= y). 


Two cards are drawn at random (without replacement) from a standard 52-card 
deck. Let X be the number of aces that occur and Y be the number of spades that 
occur. Derive p(x, y) and compute P(X » Y). 


Variates X and Y have the joint probability distribution : 


Obtain the value of a and find the marginal p.m.fs. of X and Y. Evaluate 
Р(Х = 1), P(XsIIYZ2, P(X«3| Ү< 4). 
Independent variates X and У have distributions - 
x 1 2 3 4 5 y : 0 І 2 3 
Pr > Ul Pee ee fae Os 6 0.4 03 
Find the distribution of X + Y, XY, Y/X. 


Partial information. X and Y are independent variates. Find their distribution when 
some data is provided in the following (L.H.S.) table. [R.H.S. table is solution) 


т^. 


B". 


Exercise 4(a) 1 9 9 


m sse 
1 


_ | 0.06 0.04 


һә 


0.06 0.04 


0.30 


СО ЖКС ИИ 


A coin is flipped until heads occur twice. Let Х and Y denote, respectively, the 
trial numbers at which the first and the second heads are observed. If p is the ^ 
probability of heads occurring at any one trial, find PY - X =k |X = т). 
The joint density of (X, Y) is f(x, y) = (x + 2y)/27, where x and y can assume only 
the integer values О, 1, 2. Find the conditional distribution of Y for X = x. 


Exercise 4(a) 


. Show why the functions G given below do not represent joint c.d.fs. 


(a) G(x, y)=1, x+2y21; G(x,y) 0, x *2y«l. 


(b) G(x, y)=1-e%**, xz0, y Z6; G(x, у) = 0, elsewhere. 

(c) G(x, y) 21-6" ^, x20, y Z0; G(x, у) =0, elsewhere. 

(d) G(x, y) 20, x «0, y «0, orx+y<1; С(х, у) = 1 otherwise. 
(e) С(х, y) 2l, x *yZl, G(x, y) 20, х+у<1. 


. Variates X and Y have the following c.d.f. : 


Says or y «0 
-22x«3 and 0<у<5 
Xs and 0x y «5 
—22x«3 and y25 
X 26 and yz 5 


E 


F(x, у) = 


~- 


„ 


= uj € о © 
„ 


Determine that X and Y indeed have a joint discrete distribution and find the joint probability 
function. 


3. The joint c.d.f. of X and Y is 


F(x, y)=l-et+e «e^ ", x20, y20; F(x, y) = 0, elsewhere. 
Find (a) P(-2« X <3, 1 «Y €2), (b) P(X + Y 23), (c) P(X 2 Y), (d) joint p.d.f. of X and Y. 


. Show why the functions f and g defined below cannot represent a joint probability function 


for any choice of k 


kxy, iy К 0, 1 


2. yy = - y= 0), 8 j= 
f(x, у) = E o» p iud 1 , gon у) E elsewhere 


1 
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5. 


10. 


X and Y have joint p.d.f. - 
fos y) = p/q', x=0, 1,2, ..., у; Y=0, 1,2, ., 0«p« l,p*qz 1. 
b^ PY X1). 

Find the marginal distributions of X and Y and evaluate P(Y- X < 1) 


Given the adjoining joint p.d.f., obtain a and marginal 
distributions of X and Y and conditional distributions of X 
given Y= 1. Evaluate P(X + Y « 4). 


X and Y have joint p.d.f. 


For table (a) evaluate : (i) P(Y iseven), (ii) P(XY is odd), (iii) P(X Y <5), (iv) P(Y is even and 
X^ < 2), (v) P(0« X « 5). 

For table (b) : (i) Obtain marginal distributions of X, Y. 

(ii) Obtain conditional distribution of Y give X = 2. 


. An urn possesses the distribution p(1) = 0.2, p(2) = 0.5, p(3) = 0.3, Ip S PX = x)]. 


Find the marginal and conditional distributions for the random experiment consisting of two drawings 
without replacement from this urn. What is the conditional p.d.f. of X given that X+ Y- 4 ? 


. The p.d.f. of X, Y which represent the number of bicycles produced by assembly lines A and B 


is given below : 


Find a and the marginal density functions. What is the probability that : 
(i) more items are produced by line B than by line A ? 

(ii) line B produced 3 items if line A has produced | 7 
A bivariate density f(x, y) is defined for x = 0, 1, 2, Ж. 


i Y 7 0, 1, 2, 3, ... The partial table iS 
given by 


DE 


12. 


13. 


14. 


18, 


16. 


17. 


Exercise 4(a) - 16 Я 


а = 0.01 


Find the marginal density functions and evaluate P(X + У < 5), and P(X £41 Y € 3). 
Two fair dice are tossed simultaneously, X and Y denote the number on the first and second die 
respectively. Record the sample space for this expeirment. If О = X - Y, D=| U|,S=X + У, 
T= XY; find the joint p.d.f. of D and S and of S and T. Also evaluate P(S = 8), P(S 2 8), P(U =0), 
RIS 264. Y = 4), P(Uz 2). 
[See p.15 for joint densities. P(S > 8) = 5/12, P(S; | Y 4) = 1/6, P(U = 0) = 1/3]. 
A number X is chosen at random from among the integers 3, 4, ..., 10. A number Y is then 
chosen at random from among the even positive integers less than X. Find P(Y € 5 | X = x) for 
each x, and P(Y <5). 
(a) A tosses a skew coin (head probability p) with sides marked | and 2. B spins a fair spinner 
which is evenly graduated from 0 to 3. The pay off of this game is X = A’s number — B’s number. 
Find F(x). 
(b) Select one of the integers 1, 2, 3, 4, 5. After discarding all integers (if any) less than the 
selected integer, draw one of the remaining integers. Let X and Y denote the numbers obtained on 
the first and second draws respectively. Construct the joint p.d.f. of X and Y and find P(X + Y » 7). 
An urn contains 3 red and 2 green balls. A random sample of 2 ball is drawn (a) with replacement, 
(b) without replacement. Let X = 0 if the first ball drawn is green, X = | otherwise; let Y = 0 if 
the second ball drawn is green, Y = | otherwise. Find the joint density of (X, Y) and also find 
the conditional p.m.f.'s. : 
The joint p.d.f. of X and Y is : f(x, y) = боку xs 172,37 y = 1,2. 
Show that the marginal p.d.f's of X and Y are 

f(x) = (2х + 3)/21, x= 1, 2,3; g(y) 5 Gy + 6)/2T, y= 1, 2, 
Show that P(X < 2) = 4/7 and P(Y € 2) = 1. 
The joint p.d.f. of X and Y is f(x, у) = xy/36, x, y = 1, 2, 3; Дх, у) = 0, otherwise. 
If U 2 X 4 Y, V =X - Y, find the joint and marginal p.m.f's of U and V. 
[Ans. f(u, v) = (и? -— у2)/144, over 9 points, g(2) = р, g(3) = 4р, #(4) = 10р, g(5) = 12р, g(6) = 9р, 
p = 1/36 h(-2) = 3p, h(-1) = 8р, 00) = 14р, h(1) = 8р, h(2) = 3p] 
An electric circuit is closed and opened repeatedly until two electric bulbs B, and B, fuse and 
the closures x and у at which (B,) and (B5) fuse are recorded. The variation in x and y 15 
described by the density function 

foy) = OC -0)5x, y21,2,3, .. (0€ 0« I). 

Iso find the probability that : 


Find the marginal densities of X and Y. A | 
y ipo (iii) both bulbs fuse at the same closure. 


(i) B, fuses at the Kth closure, (11) B, fuses before B,, 
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A PA EEE ea то e E . я " ; 
2 Show that X and Y are independent. 


x; Ax, y= 0, otherwise. 


18. Let P(X =x, Y=y)= Q'^!3') ' x, y= 1, 
19. Let f(x, y) = 2/n(n + 1), x 21,2, ., y= 1, 2, 
Show that X and Y are not independent. 


20. Let a and b be constants. Write P(X = т, Y = n) = fm, n). Define 


-(a + b) a p^ -m 


: n20,1,2,..; /(т, п) е0 otherwise. 


т!(п= m)! ' 
| waama 
(i) Show that X and Y are dependent, (ii) Are X and Y - X independent 


21. X and Y have p.m.f. concentrated at four points 


BE d 
Р(Х = 2, Ү=3) = 1, P(X 22, Y2-D) a, p(X 2-1, Y23) 2 b, X 2 -1, Y -D = 6. 


fin, n) = m -0,1,2, ...; 


m d. 
If X and Y are independent, show that a — i4 = т or a= b= +. 
22. X and Y are random variables with distribution shown in table (а). Are X and Y independent : 
Find the missing values. 
23. Partial information: X and Y are two independent variates with a joint p.d.f. partly shown in 
table (b). Fill the gaps. 


) 


E. 
24. Suppose X and Y are independent variates with non-negative integer values. Let 
(Р(Х = п) =а,, P(Y=n)=b,, n20,1,2, ... 
If S=X + Y, show that P(S = n)  Ya,b, |, m0, 1,2, t twi 
25. Let X and Y be discrete variates with р;= Р(Х= х, Y= Уу). Show that X and Y are indep. iff rank 
of matrix (p;) = 1. 


4.40. Continuous Random Variable 


Definition. A 2-dimensional random vector (X, Y) 
if there exists a function f (x, y) > 0 such that for 
given by 


is called a continuous random vector 
79 $35 y « «, the c.d.f. F of (X, Y) 


F(x, y) = eie flu, v) dv | du "my 
is continuous. The function f(x, y) is called the joint df. of (X Y) 


4-41. Theorem : Some Properties of Joint Density 


Let f(x, y) > 0 be the joint p.d.f. of continuous r 


andom v 
c.d.f. of (X, Y). The following properties hold - ector (X, Y) and F(x, y) be the 
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o [fec y) dx dy - 1. 
(ii) Pla<X <b, с<Ү<а) = [fi Fe. y) dy dx 


(iii) f(x, y) = OF (x, y)/ дхду. 
Proof. (i) The relation between f(x, y) and F(x, y) is 


Р(х, y) = | | fa v)dvdu. E 


Since F(+00, +00) = 1, the result (i) flows from (1) trivially. 
(ii) P(a < X «b, < Y € d) = F(a, c) - F(b, c) – F(a, d) + F(b, d) [Rectangle Rule] 


L Lf dy dx — id Be dy dx — i Iv f dy dx + f. # f dy dx 
P [Eo - aola- о-о 


f^ [feres ») dy] ax |Про) ay] de = foros у) dy ах 


р 


(11) We apply Fundamental Theorem of Integral Calculus to formula (1) to recover 


O° F(x, y)/ 0x ду = f(x, y). RO) 
valid at the points of continuity of f. But there are only at most countable number of points 
where f is not continuous (or F is not differentiable). So we are free to set f(x, y) as per our 
convenience at these points of discontinuity. Hence (2) holds for every (x, y) € К°. 


4-42. Individual or Marginal Distributions 
Let (X, Y) be a continuous random vector with joint c.d.f. F and joint p.d.f. ‘f’. Then 


F(x, у) = P(X xx, Y xy) f. | fu, v) dv du 
Since (Fax Yay} = (Gs) ТИЕ yf, hento 
(Xzx,Y«o] = {X<x} N{Y¥so}={Xsx}NQ={X <x} 
Р(Х <х, Ү< о} = P(X<x)> Fy(x) = F(x, o) 


i.e. Fix) = | à li f(u, v) dv| du= NO du where ра flu, v) dv = g(u) > 0. 
This shows that X is also continuous and p.d.f. of X is given by 


fx) = во) = [fos у) dy 0) 


Similarly, Y is also a continuous variate and p.d.f. of Y is given by 


fi» = fes» dx (2) 
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gw i ith joi ШЕ six, y). 
Definition. Let (X, Y) be a 2-dim. continuous random vector with eh ki р RÀ 
Then the individual or marginal distributions of X and Y are defined by pers. 


f.) “м is F(x; y) dy; ty (y) = iM Fx, y) dx 
Observation: Р(а < X < b) = [fx Q9 dx = Ere y)dy) dx 
4-43. Conditional Distribution Function 


The conditional c.d.f. of a variate X, given Y = y, written Fy, y (x | y), is defined by 


Fyyy(xly) = lim P(XsxlQy—e<Fsyt е)) kii) 


provided that the limit in (1) exists. 


The conditional p.d.f. of X, given Y = y, written fy, (x | y), is а non-negative function 
satisfying 


Ех |y @ly) = [fy 1) dt, VxeR. E42) 


Theorem 1. The conditional p.d.f. f(x | y) is a bonafide density function. 
Proof. The conditional p.d.f. f(x | y) is non-negative by its very definition. Further, 


ffe» dx = PFyy(oly)-l [by (1)] m3) 
Since both conditions of a p.d.f. are satisfied, it follows that f(x | y) is a bonafide 
density function. 
Theorem 2. The conditional p.d.f. f(x | y) is given by 
fyiy @ly) = Дх, YF) 
where f, is the marginal p.d.f. of Y, f(y) > 0, and it is continuous. 
Proof. By definition (1), we have 


we PASS, y mB«ESydRU FH. уа а 
x1 £04 Р(у=®&&ї <+ E) 60+ yte 
[ЕЛ dv 


We observe that 


lim ар 


20+ 2Е ?v-t 


We divide the Num. and Den. in (i) by 2g, proceed to the limits, use (ii) and a similar 
result for Den. of (1) to get 


is PON YE) Р Уа 
MEN M aa EE (VR ...(iii) 


f Sy du a Fwy) 
Еу, yo y) T f, C) = dup FO) du. 


Hence, by definition (2), we get fix ly) = Kx, yf). 
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4-44. Worked-out Problems 
Terminology. The word i.i.d. stands for independent and identically distributed. 
Example 1. A probability function which is neither discrete nor continuous. 


Solution. Let JU Py) = p'q'^"p'-!g^-'/ Bra, Ьу, x=0,1, 

where p+q=1, O«p« 1, a>O, b> 0. 

This expression is neither a p.m.f. nor p.d.f., because variable x varies only over two 
discrete values (0, 1} and the variable p є (0, 1). Nevertheless, 


a-l b-] 


1 1 
Уб, p=" 1 _ OPES = g(p), say, уле p |a= |р" 14" dp! Bla, b)=1. 
х= ё 0 


This shows that f(x, р) is a probability function. Expression for g(p) reveals that 
р = B (a, b). The marginal density of X is 


ранен. В(а+ x,b—- х +1) ко, if xe] 
0 B(a, b) B(a, b) b/ (a + b), if x=0. 
Example 2. Random variables X, Y have the joint p.d.f. 

Хх, у) = k(x + y), O< x, y <1; Дх, y) = 0, elsewhere. 
Find k and determine the distribution functions F(x, y), F(y | x). Are X, Y independent ? 
Prove that the marginal densities do not determine the joint density uniquely. 
Solution. The norming constant К > О is obtained by normalization : 


nix) = [ f(x, p) dp = 


= kf h Ge» dx dy - k |, (4) y] dy 2 К+ 2) 2 k; ice. k=l. 


fios fat y)dy=xtt, 0<х<1; /(у)=у+1,0<у<1. (1) 
Since f(x), (у) # f(x, у), we infer that X and Y are not independent. 


x=0 x=1 X = 00 
While calculating F(x, у), we drag indicators 7, = (0 < x < 1) and I, (0« y « 1) ; 
= KI € x «€ o), J, = I (1 < y < o) along side, a useful trick. 


= › ia 
P y) = I, 1, [ d (и + v) du dv +1, J, f Í, (ut v) du dv +1, .J, |) MC v) du dv 41. J, J 
= Lo3y xy) М, +40 +x), J thot yh л+л h 


ОЬ G*9»h dcr] 
fOID= Fat, +0) 
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y y (x*t)dt. [xy * (у” 2) О<у<1. 
Fix) e а ьа) Б rr wor pay 


ULL Ox ysl. 
Non-uniqueness. Let g(x, у) = Лбх) Lhoh eix " 4) (y + D 


(cen Gears (e n 7 AO 


Then g(x) 


Similarly, g0) = (y*1)5-2 £O). 
me marg 
Thus, two different continuous distributions f and g possess ET Bb join 
distributions f, and f,. It follows that marginal densities do not de 
density uniquely. 
, T? ea ut. : 
Example 3. Variates X and Y follow a bivariate Dirichlet distribution defined by p 


inal 


Хх, y) = x"! y! a-x- у)! у В(а,Ь,с), x20, y20, х+у<1, а>0, b>0, c70, 
where В(а, b, c) = T (a) F(b) F'(c)/ F'(a + b + c). Find the marginal and conditional densities. 


; : . Г(а)Г(Ь) Г(с) Ta@rbt+c) T OTe) 
Solution. Obviously : В(а, b, с) = отера CT X FOFO S 


= B(a, b + с). B(b, c) = B(b, a + с) B(a, c). 


© Nm n. výs (T 9 
Хх) = gd fo» dr- pen b Lal E ату аи — x) u, dy = (1 — x) du] 
Y 
а-1 (р ahei b-1 1—4 ід k | 
- df d [Value of integral is unity] 
= ‚чы Б днн O<x<l. 
B(ab-c) ' 
Similarly, f) = y (1 e "Bb ас), O<y<1. 
So, if (X, Y) ~ Dir (a, b, c), then X ~ В, (a, b + c) and Y ~ Pi (ya + c). 
Since, Дх, y) * ЛО) hO), the variates X and Y are not independent. 
_ fo». у 05x 
Join = FO) Be, c).—xypret? 08951-0, 
_ fo» zx gee 
Ху) га fh.) Ы B(a, с) -, О<х<1- y. 
_ T(a) ГР) Г(с) F'(d) 
Note. Bla, b, e, d) = IDEAE UE 


= B(a, b+ c * d) (B (b, с, d) = B(a, b + с + d) B(b + c, d) Bib, с). 
Beta function notation with more than two arguments is due to present authors. 


$4-44. Worked-out Problems 
Example 4. The variates X and Y have the joint p.d.f. 
Кх, у) =x + y for 0 < х, у < 1; Дх, y) = 0, elsewhere. 
Find P{2Xs1/1(X+Y) <1}. 
Solution. Here p = P(2X Sl, X Y< 1}/P(X + Y) <1) 
= P(T)/P(S) STT) 
where Г = (2х < 1, х+у< 1} = (0<х<1,0<у<1- х) 
region OCDB. н 
= {х+у<1)} = {0<х< 1,0<у<1- х), triangular region ОАВ. 


0 


p= | [| Gy dxdy- 5 [^ а- х?)ах= 1. 


P(S) : 


IF "Л (х + y) dx dy 21 | (1- x^) dx 24. 
pai pe [by substitutions into (1)] 
Example 5. Random variables X and Y have joint p.d.f. 
Rx, y) = (2m xy) exp [-4 (bn? x + бп y)| “у> Y 0: 


Are X and Y independent ? Find the marginal density of X. 
Solution. We can factorize the joint p.d.f as 


f(x, у) = (/2 V27 x) exp[-+ @nx)?] (V2 {от у) exp [-14»] 


i.e. Kx, y) = ЛО) -£,0); x > 0, y > 0. uth) 
We recall that if Z ~ L-N (и, o^), then 


ft) = (с 2n 1)! exp E | t» 0. 


If follows that X ~ L-N (0, 2) and Y ~ L-N (0, 2) and that X and Y are independent 
distributed. [by (1)] 
Example 6. Let f, g, h be three p.d.f.’s and F, С, Н their corresponding c.d.f.’s and 
suppose a is constant, | a | < 1. Let 
Fix, у, 2) = fx) g(y) A(z) {1 + aD2FG9 - 1]. [2G(y) - 1]. PHQ) - 11}. m 
Show that f, is a p.d.f. for each a in J = ] - 1, 1 [. Find the marginal p.d.f.'s of the joint 
density function Fs y, 2). 
Solution. 0 < F(x) x1 > 0 €2F(x) 22 -1 < 2Е(х) -1 < 12» I2F() - 115 1. 
Also l a < 1, it follows that the product of four numbers in [-1, 1] also lies іп [-1, 1]. 
Thus bi sa (2Е +1) (26-1) QH= 1) & l. 

1 + а[2Е(х) – 1] [26(») - 1] [2H(2) - 1] 2 0 > f, y. 2) 2 0. 


Further, (^ у(х) (2Р0) – Пах = 4f! г =0. [t= 2Р0) -1] (i) 
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Hence integrating (1) between —9% < х, y, z < %, We get 
fff. o у, dx dy = |, Ро) ах. |? во) ау. | п dz 


«[ [2F(x) - 1 f(x) dx. |” [2G(y) - 1] g) dy. |” [2H(z) - 1) h(z) dz. ...(ii) 
On the R.H.S. of (ii) the value of each factor in the first term is unity and the value of 
each factor in the 2nd term is zero [by (1)]. Hence 
fff Gs y»zdxdydz 21, —o«x,y,z«o. 
It follows that f, is a p.d.f. Integrating (1) w.r.t. y and z — oo (y, z) < ©, we get 
j fa (х, у, z) dy dz = f (х) 80) dy Í h(z) dz - d2F(x) — 1] feo [2609 - 11 a0) 4v [2H(z) – 1] A(z) dz 
ei Jy wi o SW EFE TI. 0,0 3 Ду). [by (1)] 
Thus the x-marginal density of f(x, y, z) is f(x). Similarly the.marginal p.d.f's of Y and 
Z are g(y) and h(z) respectively. 
Comment. The function f. у, z) gives an infinite family of joint p.d.f.’s which have 


the same marginal densities. It follows that the knowledge of marginal distributions 
alone is not sufficient to determine their joint distributions. 


Problems with Solutions Provided at the End of the Text 
1*. Show that if X, Y, Z are i.i.d. continuous variates, then 
P(X«Y)- =, POS TX 2)e 4 
2*. Let X, Y, Z be i.i.d. continuous variates. Evaluate 
(i) PX» YIX»2, (i) PX» YIX«2) (ii) PX» YI Y» 2), DUX > ҮТҮ < 2). 
53е. Тах, Уа A^ {ЛЛ 9; y 2 0, and f(x, y) = 0, elsewhere. Find 
(а) Р(Х < k), (b) Р(Х > kY), (с) P[(X/Y) < А], 
@)FIK< ¥IX< 27), (OPEET <9); 
(f) Find m such that when A = 1, P(X + Y < m) = d 
(g P[O« X«11Yz 2]. 
4*. The joint p.d.f. of (X, Y) is given by 
fix, у) =2,0<y <x; f(x, y) = 0, elsewhere. 


Are X and Y independent ? Find the conditional 
density functions of Y given X = x and that of X 


given Y = y. Compute P(1 <Х< 3 IY= 1). 


5". 


6*. 


Tf» 


p", 


10*. 


11%. 
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The joint p.d.f. of X and Y is given by EX. 
Дх, у) = kx(x - y), 0 < x < 2, . x < y <x; Дх, y) 2» 0, elsewhere. 
Evaluate the constant k and the marginal probability density functions of the 
random variables. Find the also conditional p.d. ror" given x = x, 


The joint p.d.f. of random variables Xy Ro 
K(x, y) = ke * xe UR у < х < ©, f(x, y) = 0, elsewhere. 


Determine k. Find marginal and conditional p.d.f. and evaluate P(Y 2 3). Are X 
and Y independent ? 


The joint p.d.f. of variates X and Y is 


fx, у) = [2) (G—x—y¥),0<y <2 72 y <4; f(x, y) = 0, elsewhere. 
Find P(X < 1, Y < 3, PX + Y < 3, P(X < 1 | Y < 3). Find also the marginal and 
conditional distributions. 
Two dimensional r.v. (X Y) has the joint density 
fix, у) = kxy, O< x< y< 1; f(x, y) = 0, elsewhere. 
Find (1) k and marginal and conditional distributions. Are X and Y independent ? 


(ii) Joint distribution function of X and Y. (iii) PIX «1Iy <4}. 


Variates X and Y have the joint p.d.f. as : 
М y) = La sin jn +y), 0<х<1, 0<у<1; f(x, у) = 0, elsewhere. 


(а) Find the marginal p.d.f. of Х. Are Х, Y independent ? 

(b) What is the conditional density function g(y | x) of Y for the given value x of X ? 
(c) Find P(X » 2Y). 

It f(x) = ар. DOES Moe f(y | x) = xy" ', 0 < y < 1, determine the 
unconditional density function of Y and the conditional density function of X 
given Y. Also evaluate P(Y > + | X =k) and P(X=kIY< ih 


Let X be the time you get out of bed in the morning (measured in fractions of an 
hour past 6 A.M.) and let Y be the length of time it takes you to get to your office 
(in fractions of an hour) after getting up. Assume that the conditional density of 
Y given X = x and the marginal of X are 


. 


— — 
Pads I a S Е уз Fe 0-3) .0«1«3 


Given that it took you 30 minutes to get to your office one morning, find the 
probability that you got up by 6.15 a.m. that morning. Given that it took you 50 
minutes to get there, find the probability that you left your bed later than 6.20 a.m. 
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Exercise 4(b) 
1. (a) If f(x, y) = k(1 +х+ уу, x> 0. y > 0, show that k = 2. and (х) = ( 1 + ху, хэ 0 апа F( Th 


1- (1+) (жуу (109x4y)*. 
(b) Determine k such that the joint frequency function of a p 
is f(x, y) = K(xy + 2x + 3y + 6), 0 < x, y < 1 ; Дх, y) = 0, elsewhere. 
Show that X and Y are independent. 
2. The joint distribution of the continuous r.v.s X arid Y is 
Ах, y) = ko + y), O<x<y<l; f(x, y) = 0. elsewhere. 
Determine k and the marginal distributions of X and Y. А 
[Ans. k = 3, f (х) = (1 + 3x° = 4x°) K0<x< 1); (У) - 4y KK(0«y«1).] 
3. The joint p.d.f. of bivariate г.у. (X, Y) is given by 
fix, у) = 4x + yy5x', 0<у<1, 1 <х<о; Дх, y) = 0, elsewhere. 


(i) Show that P(0 « y « : IX =2)= 9/20. 


air of continuous variables (X, Y) 


[Ans. k = 4/35] 


(11) For what value of a is it true that P(0«Y« д ІХ>а) = 5/16? [а = 1/12] 
4. The joint p.d.f. of bivariate random variable (Х, Y) is given by 

Tx, y) = cy’, O<lyl<x, 0<х<1; Дх, y) = 0, elsewhere. 

(i) Show that P(O«Y« 4 IX- 1 }= CL. 


(ii) For what value of a is it true that P-a <у<а!Х= 1)= 1 ? [a = (1/2)*] 


5. Let f(x, y) = 1, when 0 < x, y € 1 and f(x, y) = 0, elsewhere. Prove that 


(а) P(X«i,Y«i)21, (Б) P(X»2Y)- i, (с) PUC + ү « 1 1 2/16. 


(d) P(X» Ygiven Y» 5] = у, (е) Р{Х+Ү<1}= 1, (фу PX» 1)- 2, 
(g) P{XY>k}=1-k+kmk,O0<ke<l. 

6. The joint p.d.f. of random variables X, Y, is given by 
fix, у) = 1/(na°), 78 y <a’: Six, y) = 0, otherwise. 


(i) Show that the marginal distribution of X is ў (х) - Е = х? /та?] I(-a € x <a) 


Find the conditional distribution of Y given X = x, where | xl <q H I 
mutually independent. > а. Hence determine if X, Y are 


(ii) Show that P(the distance from the origin of the point selected is not greater than R) — Ra’. 
(iii) Evaluate : PUXI< 4 1YI» 3)and P(X?’ + Y> 3 e! ix c yy 

7. The joint p.d.f. of X and Y is given by 
Ах, У) = ky? -x) e^, -у<х5у,0<у<%; fx, y) 20 elsewhere. 
Find k and the marginal densities of X and Y as well as Fy, Fy, F(x, у) 


[Ams. k= у, 6) 7 Ce TO 01x) Ho e x <0) o) = (Ee? y! (0« y «») 


8. The joint p.d.f. of X and Y is given by 
fix, у) = ky y - x), -y < x <y, 0 Sy X2 ; f(x, у) = 0, elsewhere, 


10. 


11. 


12. 


15. 


14. 


15. 


16. 


Exercise 40) 1 Г 1 


(i) Find k, (ii) Find the marginal densities of X and Y. 


(ii) The conditional distribution of X, given Y z y. 
[А п. k = 1/8; f(x) = (1/48) (P = 1204. 16) /(-2 <x <0) + (1/48) (x° – 12x + 16) (0 € x < 2); 
fi) = (1/4) y! КО < y <2); fixl y) = (y-x)/2y’; 1х1<у,0<у< 2]. 


. The joint density of X and Y is given by 


Хх, у) = kx? (8— у), х<у<2х,0<х<2; f(x, y) = 0, elsewhere. 

Find the constant k and the marginal p.d.f.’s of X and Y and the conditional p.d.f.’s 
[Ans. k = 5/112; f,(x) = 1 kx? (16-33) K0 <x <2). 

hO) = (7k/24) y (8 y) (0 < y < 2) + (k/24) (64 — y`) (8- у) (2 <y € 4)] 

The joint p.d.f. of X and Y is given by 

Дх, у) = 4ху, 0€ x « 1,0« y« 1; fix, у) = 0, elsewhere. 


Show that X and Y are independent. Also prove that the probability that exactly one of the 
random variables is greater than a given constant k, where k < | is 261 а? 


Prove further that F,(t) = Еу) = г, F(x, y) = x. у>. 
(a) Let the joint p.d.f. of X, Y be fx, y) = 4, Ix yl& I. 


Show that X and Y are identically distributed :f(r) = 1 -1tl, -1 «t€ 1 butare not independent. 

(b) If X and Y are i.i.d variates with p.d.f. f(t), that is symmetric about t = 0, show that 

pzPUX-«rYis2 ys. 

Evaluate p for some different symmetric density f(z). 

The joint p.d.f. of X and Y is f(x, y) = kxe ' * P, x 2 0, y 2 0; f(x, у) = 0, elsewhere. 

Find (a) the constant k, (b) the marginal densities of X and Y, (c) the conditional densities. 

[Ans. k= 1, f,(x) е x 30) (у) = (1+ Y” IO 20) ;f(lx) = xe? Ку > 0)] 

The joint p.d.f. of X and Y is f(x, y) = Kxy + €), 0 x, y € 1 ; f(x, y) = 0, elsewhere. 

Find (i) k, (ii) the marginal densities of X and Y, (iii) the conditional densities, (iv) Are X and Y 

independent ? [А п. k = 4(4e - ON ЛО) = (2) [x + 2e |, hO) = (k/2) (y + 2e - 2)] 

The joint p.d.f. of X and Y is f(x, у) = k(x + у), 0 < x <a, 0 < y < b; f(x, y) = Oelsewhere. 

Find (i) k, (ii) the marginal and conditional densities of X and Y, (iii) P(X >a | Y > 5/2). 
[Ans. k = 2/ab(a + b) ; f(x) = (2x + bya(a + b) ; fx | y) = x + yya(a + 2y) ; p= 0] 

If fix, у) = ax)y + 3ху”, 0<х<1,„0<у=< 1 ;7его elsewhere. 

(i) Find the marginal and conditional densities. 


(ii) Evaluate P(+ <X< 3 | tiger): 
[Ans. (0) = 0) = 4 (3. + 2); p 2 311/32), AW) +. у) 


(a) fix, y) 224y (1 23), 0 <x < 1, OS y <x ; f(x, у) = 0 elsewhere. 
(b) Дх, y) = 2ху, 0 €x, y <1, x 2y i fx, у) = бху, 0 Sx, y & x « y. 
(i) Find the marginal and conditional densities. Are X and Y independent ? 
(ii) For (b), evaluate P(A U B), where A = (X € +), B={Ys $h 
[Ans. (a) f,(x) = 12x? (1 — x) /(0< x < 1), AQ) = 12y I -yy K0«y« 1) 
fa«ys20-30-»*19«x« Dao la) = 2px K0«y«2. 
(b) ДО) = x3 - 2х2) KO « x « 1.50) = + 2y*) 10 « y« 1), р= 7/16.] 
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17. The joint p.d.f. of X and Y is f(x, у) = Gy, 0<х<2, 0 < |; flx, у) = 0, elsewhere 


(i) Find the marginal and conditional distributions. Are X and Y independent ? 


[Ans. f (x) = + fly) = Зу”, Indep. P(Y € kX) = 2k) 


(ii) Find P(X € Y), PO < X) 


18. The conditional and marginal densities are 


ЗхФ у ay Sat >, 
P > 0: ja ey Ї!; 
fivix)= irai QEXU Mee, fj) "yw X 
Find the joint density of X and Y and the conditional distribution of X given Y = y. 
[Ans. fix, у) = (1/4) (Bx + y) e  * u(x) uy); fixly)=Gx+y)G +. y x» 0]. 


19. Let fxl y) 2 y e?/x , x 20, 1,2, ..: y 20; {х1 y) = 0, elsewhere. 
(a) Show that f(x 1 v) is the conditional p.d.f. of X given Y= y. 
(b) Let the marginal p.d.f. of Y be (у) = ke", у> 0; (у) 20, elsewhere (A > 0). 
Find the joint p.d.f. of X and Y and the marginal p.d.f. of X. 
[Ans. (a) fx l y) ~ pois (у). fx, у) = Ae  * 9" yet. f) S pq. PEA +A) 
20. If fix. оні E ! e? for0 < x< y< oo, show m gam (1, m) and Y - gam (1, m+n). 


21. Let f(x) 2 2, x 2 1,2, .. and fy lx) = х(1- yy ', 0< y < I. Show that the unconditional 
жаы КЕ of Yis g(y) = 21 +y) 0 zys 
22. The time taken by a garage to repair a car is a continuous random variable with p.d.f. 


y= 3 х(2- х), O<x<2; f(x)=0, elsewhere. 
If, on leaving his саг, a motorist goes to keep an engagement lasting for a time Y, where Y isa 
continuous variate, independent of X, with p.d.f. 
2(у) = y2, 0<у<2; g(y)=0, elsewhere, 
show that the probability that the car will not be ready on his returns is 3/10. 


4-50. One Function of Two Random Variables. Standard Formulas 


Let the r.v. Z be a function of two r.v.s. X and Y, say 
Z= g(X, Y) and suppose F;(z) and f7(z) are the c.d.f. 
and p.d.f. of Z respectively. We want to determine these 
functions in terms of g(x, y) and the joint p.d.f. f(x, y) 
of X and Y. 

Distribution Function. Let A; be the region of the x-y 
plane such that g(x, y) € z. This region can be multipli- 
connected. Since {Z < z} = ((X, Y) є А, }, it follows 
that P(Z < z) consisting of all outcomes @ such that Z(@) = z equals the probability mass 
in the region A7. Hence 


F(z) = PIZ«z) = {(Х, Y) € AJ = ff, f; Gs») dxdy NU 


Probability Density Function. The density f(z) can be found by differentiating F.(<): 
It may be directly found by determining the region бА. of the x-y plane such that 
z< р(х, y) € z + dz, since 

{z<Z<z+dz} = {(X, Y) є A.) (0) 
But P(z<Z<ztdz} =f{z) dz [by Def.] .. (il) 


. $4-51. Dist. of Sum, Diff., Product & Quotient of Two Variates | 1 73 


As we see from (i), the probability in (ii) equals the masses in the region дА. Hence 
©) = P(z<Z < z+ az)- M fy z G9 y) dxdy (2) 
Some illustrations of these results follow. 
4-51. Distribution of Sum, Difference, Product and Quotient of Two Variates 
(i) Distribution of Sum : Z =X +Y 
Let Z = X + Y, and set A. = {(x, у): x+y <z} : the shaded region in the figure 
F(z) = iy f(x, y) dxdy = f= ie (x.y) dy| dx adii) 


Put x + y = u, dy = du and rewrite (i) after interchanging the order of integration : 


F(z) = T E f(x,u— x) du) dx = DE Mr f(x,u — x) dx) die, Gd) 


Differentiating this Integral w.r.t. ‘z’ we obtain the p.d.f. of Z as 


f(z) = ү хуб, 5— x) dx iw L) 
If X and Y are independent, then (1) gives 
Ро) = 50) G- dx. (Q2) 


The p.d.f. of Z given by (2) is called convolution of fy and fy. 
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(ii) Distribution of Difference: Z = Y - X | 
Let Z = Y — X, and set В. = {(x, y) : y - x € z}, the shaded region in the figure. Now 
= y dx dy 2 [P | T fx, dy| dx Ai) 
Еда) 1], f(x, у) dx dy " r f(x, у) dy 
Put y = u + x, dy = du and rewrite (i), after changing the order of integration : 


Fz) = м Ill f Gs ue x) du|dx- |, Is fla, x +u) dx] du mi 


Differentiating this integral w.r.t. z, we obtain the p.d.f. of Z as 


f£) = k fix ee Dd He 425.9 ET 
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If X апа Y are independent, this gives 
f) = E fi CO fx FR) dx, –-%0<2<% 


(iii) Distribution of Product : Z = XY 
Неге: {Z <z} = (XY < z} = (6, y) : x < 0, y > ax} О (0, у) :х> 0, У 
Fz) = f (f. FG: ››ау)ах+ J тА, f(x, y) dy) dx. SN 


f integration : 


< z/x} 


Put y = u/x, dy = du/x and rewrite (i) after changing the order o 


F{z) = | ts f(x и) de Jas +h (E 16 JEJE 
ШШ ДЫ е -o 


Differentiating this Integral w.r. ... ‘z’, we obtain the p.d.f. of Z as 


8 


Z dx 
ло = fr E b f Qai) 
E pi 
us fev 2) a (1) 
L y ў 
m хус; У = 2/Х === ур = 
EE ry 
EI] j == : 
У = 2/х E ху $2 === === uU =з 
: TE M —— 
If X and Y are independent, then (1) provides 
ro = [5e (2). NO 
(iv) Distribution of Quotient : Z = X/Y 
Here : (Zsz) = (X/Y &z) = (x,y): y» 0, x x yz) U {(х, у) :y «0, x 2 yz] 
00 yz c а 
Fz) = Í, ([ tos ax) dy [7 л») (i) 


Put x = uy, dx = y du and rewrite (i) after changing the order of integration : 
o0 Zz 0 T 
Fz) = и (ЖТ? y) ydu) dy+ f (f f (uy, ») y du) dy 


= Ets ydy)du+ f° (р шуу) fi 
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Differentiating this Integral w.r.t. ‘z’ we obtain the p.d.f. of Z as 
E [^ uu 0 1 Р 
Jz) T 0 I (yz, y) y dy + a f (yz, У) ( y) dy = | Ў fx y (yz, y)l yldy. NU ) 
If X and Y are independent variates, (1) reduces to 
ILD = E fsoafoylay. kD) 


4-52. Convolution of Two Distribution Functions 


Em A function f on R is said to be convolution of two d.f/'s F, and F5, written 
Fe F,* F if 


F(x) = i Fx Ру) ER. Mas 
Theorem. The convolution function F of two d.f's F, and F, is itself a distribution function. 
Proof. F(x) = | R(x-y)dF(y), xeR (Def.) (1) 


As F is increasing, so F must increase. Since the function F, is bonded by 1, 
[0 < F,(t) < 1] and lim F(t) = Е (оо) = 1, 
to 


lim F(x) = | lim А у)аР,(у)= | 4,0) =1 


i.e. Е(оо) = 1. Similarly, F(—o») = 0 
The function F,, being a c.d.f. is right continuous i.e. lim F(t) = F,(a), [0 < Fs 1] 


lim F(x) = lim | RG-»450)- |? lim F(x- y) аву) 


ха? 


(Е = F(a- y) dF,(y) = F(a), [by (1)]. 


This shows that F is right continuous. 

. Since F satisfies all the properties of c.d.f., it is necessarily a distribution function. 
Remark. In the above proof, we have used the fact that if the functions involved are 
bounded, then the integral (Reimann-Stieltjes) and the ‘limit’ can be interchanged. 
This fact is called “dominated convergence theorem". 


4-53. Distribution of the Maximum and the Minimum of Two Variates 


(i) Let U = min (X, Y) ; then 

Fu) = P{U <u} 21- P{U > u} = 1 - P(min (X, Y) >u} 21 - P{X > u, Y > и}. sxe i) 
Of course, =œ < и < oo. If X and Y independent, then 

PIX» u, Y» u} = P(X и) P(Y > u) = [1 - Р(Х < u)] [1 - P(Y < u)] = [1 — А) [1 - Ёу(и)] 


т F(u) = F(u) + Fu) – F(u) Fu) SK) 
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So f (и) = уби) + fu) - Fy(u) — flu) f(u) Fu). [f ym Fu). ...(3) 
(ii) Let V 2 max (X, Y); then 
F fv) = P{V <v} = P(max (X, Y) < у} 2P(XswYsv)z Fy y (V, V) "25 
If X and Y are independent, then 
Fv) = Fv). Fy) =0 < V < 0 eae) 
= Flv) fv) + fv) Fahy). 00 = F'(t)] ...(3) 


4-54. Distribution of Order Statistics 


Let X,, X,, ..., X, Бе i.i.d. continuous variates with common c.d.f. and p.d.f. as F and f 
so that f= F'. Consider a linear transformation that places (X,, ..., X,) in non-decreasing 
order. Thus 


= X, = smallest of (X,, ..., X,] 
= X, = second smallest of {X,, ..., Xn) 


E "e 


DD 


Y, = X, = kth smallest of (X,, ..., Xa} 


Y, = Xim = largest of (X,, ..., Х,) 
Then Y, = = Xi» J = 1, 2, are known as the order statistics of {X,, ..., X,}. 
Distribution of Xi: 
P(X,,, < x} = P{At least r out of n variates are less than x} «ef E) 


Write temporarily: p = P(X<x)=F(x),qg=1-p=1- F(x), р = Е(х) =f) 
4 = —f '(x). Then (1) can be written as [Y, = X] 


prt 


nuu X |4 [р = success’s probability] 


Differentiating w.r.to x and taking p' = f(x) common out of sums, we get 


n n! pl М k n-i gt pkg" k-1 
gU foie а DI уттура k- 1) 


kz 


In the second term, put k = j — 1 to get 


т k)'(k р)! Pie. DIG)! 


80) = es 
k-i n-k 
= f(x).T, 
os) al al 


= (n-ry(r- 1)! 


| n | [Е х)! И [FONI " П = Fix" 


r-lln-r 
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We can rewrite this result as 


n 


8, 09 = | | [й f(x) dx| WI : | MIC ax] e 


r-llLlnn-: 


Special Cases : 


~ 


Y, = min (X, ..., X,), Y, = max СЪ & median (X554 X,) 


n 


to p=] 
8&0) = nf y) (7р го) ,—%0 < уу «0 


&g,(Y,) = nfof f(x) ax| à — 00 € y, <0 


Suppose n = 2m + 1; then X- Dax 


(2m + 1)! 
т! т! 


h(x) = [ ds | f(X) їн f(x) ах |. —o«X«o 


Note that for n- 2m, X -1(y, Ty i 


4-55. Worked-out Problems 
Example 1. The joint p.d.f. of X and Y is 
fix, y) = Аел), A > 0, x > 0, у> 0; f(x, у) = 0, elsewhere. 
Show that the p.d.f. of Z = EX +Y) is g(z) = 4\2 а @< suc d 
Solution. G(z) = P(Z€z) = P(X + Y < 22) = PO« X < 2z, 0 < Y < 2z — x) [(X, Y) indep.] 


2) 


^" Td инн Me ^U * dy dy ET he Ae" TI £ e heii? dx E ML се s. е2) 4х E 2 (1 4 2A2e^ LZ 


g(2 = С'(0) = 42е. 
Comments. Тһе mgf method dissolves the issue most quickly. 


Example 2. The joint p.d.f. of X and Y is given by 
fix, y»23x0«yc«x 0<х<1; f(x, y) = 0, elsewhere. 


Find the p.d.f. of Z = X - Y. 


ables 
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E аздай l ex E | 

Solution. G(z) = Р(2<2) = Р(Х -Ү 5 2y=P(Y 2X -2)= Ле, y) dx dy 
z х 1 x 

= ], Зх dxf, dy Vi ji 3x dxf dy 

= з dx + зај хах = (32 2°)/2 


g(z) = G(z)= 3(1- 2),0«z«l. 
Note. Examples 1 and 2 can be dealt by Jacobian method rather quickly. E 
Example 3. Let X, Y, Z be 11.4. N(0, 1) variates. Find ће p.d.f. of W = Dy .z 


Solution. Here f(x) = (J2ny е ?, -œ < x < c, etc. Now the joint c.d.f. differential. 
of X, Y, Zis 
dF(x, y, z) = f,(x) dx ју) dy f(z) dz A, y, z) = f1 690 AO) (о) 


(1A 2ny) e *Y * gy dy ас. 0) 
This form suggests using spherical coordinates (ғ, >, Ө) given by x = r sin ф cos 0, 
у = г sin ф sin Ө, z = r cos ф. 
Here 0 (x, y, z)/O(r, ф, Ө) = r^ sin ф, dx dy dz = г? sin dr do 40 

x-y-.22f, 0.<-ф<т.0 30S 270 Sis Ww. 
Now Fyw) =P{W<w}=P{X +Y +Z <w} 


3i [Jog f у, ) dxdyaz, ner x «y «z«w) 


2n en ew(. 1 à 2 2 
f | $ = е" .(r^ sin $) dr dO d$, [by (i) in sphericals] 


E fire” ar 


Differentiating this w.r.to w gives 


2 2 -w° 
fw) = -£ Fy (w)= ie hs ig 
0, if w<0 


[W ~ xa). 


Problems with Solutions Provided at the End of the Text 
1*. The r.v.'s X and Y are independent with Y ~ U (0, 1).If Z2 X 
Fz) = F(z) - Е (= - 1). 
2*. If X and Y are 11.4 Expo (A) variates, find the 
V = max (X, Y). 


* Y, prove that 


p.d.f. of (ay tj & min (X, Y), (D 
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4-60. Two Functions of Two Random Variables 

Let the variates U and V be functions of random variables X and Y say, U = g(X, Y), 
V=h(X, Y) and suppose Fy y(u, v) and fj, (и, v) are the joint c.d.f. and p.d.f. of U and 
V respectively. We want to determine these functions in terms of g(x, y) and h(x, y) and 
the joint p.d.f. fy у(х, y) of X and Y. 

Joint Distribution Function. Let By, be the region of x-y plane such that g(x, y) < и 
and h(x, у) < v. Since {U < u, V < v) = ((X, Y) є By] it follows that P(U < u, V < v) 
consisting of all outcomes c such that U(@) € u, V(o) < v, equals the probability mass 
in the region В, у. Hence 


Fyy (Ч, у) = ||, fxr 0 у) ахау. L 


[We interpret fy ,(x, y) as surface mass density in the x-y plane] 
Joint Density Functions. The p.d.f. fy (и, v) is given by 


fy, уби, v) = 2, fy Q9) AM T) 
where (x, yj), = 1, 2, ... are the real solutions of u = g(x, y) and v = h(x, y). 
Proof. Let ÒB, be the region of points іп the x-y plane such that 
u < g(x, y) < и + du, v < h(x, y) < v + dv. 
Obviously, {u< U <u + du, v < V < v + dv} = ((X, Y) є Buy wth) 
But, P(u< U <u+ du,v < V <v +dv) = fy y(u, v) dudv aii) 


As we see from (i), the probability in (ii) equals the masses in the region 58,,,,. Hence 


fy, уби, v) du dv = Il fer. y) dxdy ...(iii) 
Given v, u the region 5B,,, consists of differential parallelograms, one for each solution 
(х, y) of u = g(x, y) and v = A(x, y). From Calculus ахау = | (x, yu, v) du dv 
hence the area of ith parallelogram is dx,dy; and it contains the probability mass 
fx, y (Xis у) ахау, = fx. y Gi yi) O(x;, y,)/ Ou, v) ldudv = fy у(х, yi)! Ji dil . 
Summing the probability masses іп all parallelograms, we obtain through (iii), the result 


fuy (u, v) dudv = b зә ЖО du dv = 2M | fy y (Xj, У) dudv. 


From this result Eq. (2) follows instantly. 
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4-61. Distribution of Sum, Difference, Product and Quotient via Jacobians 
In each of the following cases, we use an auxiliary r.v.W. 
(A)Let Z = aX + bY. Put z = ax + by, w =x, then | ô (z, w)/A(x, y) | = b. 

aw 


From : 87 и (2, №) = TS y) AJl= Д» T 


1 i l 
b s integrating out w we obtain. 


— ау 
gj) - | Aw sat) de [aSbel-9Z2-2X«Y,—a- blæ ZY- xX] 


&5(<) = f fw. z-w)dw,  gp(z- ГА», w - z) dw. 
(B) Let Z = XY. Put z = ху, w = x, then 1 2 (z, wyO(x, у) 1х1 21 wl. 


Ox, y) 
O(u, v) 


| : 
= f(w,z/w).——; we integrate out w. 


From : gz y(z, м) = f(x, y) Бый 
w 


„о = Гено 
(C) Let Z = X/Y. Put z = х/у, = y, then | A(x, yyO(z, м) | 31 w I. 
Ox, у) 2) 


From : g; Wz., w) = Дх, y) Ex: = f(wz, w).Iwl, we integrate out w 


gz) = |" fiwz, w)lwldw. 
Cor. Let X and Y be independent. Let S = X + Y, D = Y - X, Р = XY, О = Y/X. Then 


gs(z)= [fos z- а еу) = ло) лах) а= [^ р-у) KO) dy 
800) =. [ fo z* x) dx = Ѓғас+уу%= f. AM ЉС x) а= [ (+ у) f(y) dy 


s [rs 26 WIE "RS Le ДЕ Wet NIE jog 


lyl 
go(2)= [fa z)lxldx= ri э) X dy = LADA = fr g (2 jog 


4-62. Worked-out Problems 
Example 1. Let X and Y be 11.4. N(0, 1) variates. Suppose that 
X = R cos 9, Y = R sin 0, Oc R«o, 0<0 < 2л 
Show that 
(i) R ~ Rayleigh and Ө ~ unif (0, 27) are independen.. 
(ii) R? ~ expo (4) and 0 ~ unif (0, 2) are independent. 


[Of course, (ii) follows from (i) by a simple map] 
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Solution. The joint probability differential of X. y i« ENERO 


s Й pus t x y- Qr + y! n 
Ixy) dx dy. = f, (x) ах. Jet y) dy = ae dy m. 
om ; ) 


a 


(i) Let x 2rcos0, y=rsin6,10 Ө) г = rand (1) reduces to 


^ ] 12400 
g(r, Ө) 40 dr = (sea) (ге Cdr), 0«0«2n, 0«x«o. 


This shows that К and Ө are independent distributed with stated densities. 


ii) For convenie i — R? \ 
(11) nce, we write W = А”. Then set x = Jwcos0, y= Vw зїп Ө 


A(x, y) cos0/2/w  sin0/2Jw | 1 
O(w, Ө) -JwsinO vw cos | 2 


The joint probability differential (1) now reduces to 


h(w, Ө) 40 dw = (edv) (2) 7 О <и< о, 0 < Ө «2. 
Л 


This shows that W = R^ and Ө аге independently distributed with stated densities. 
Example 2. Suppose X = Jw cos@, Y = Jw sin0. Let W = R° ~ expo (1) and Ө ~ unif 
(0, 2л) be independent. 


Show that X and Y аге 1.1.4. M(O, 1) variates. 
Solution. The joint probability differential of W and 0 is 


fiw, Ө) dwd = (4e"dw)(d0/2n) - (2) 
Now x? +y? = м, 10 (x, у)/д(и, 0) | = 1, hence dw 40 = 2dx dy. 
Substituting into (2) yields 


1 A(x? + у2)/2 
g(x, у) dx dy = 778 ig 


los у, ey 
——áe drm 2) —9%0<х,у<9%. 
|б“ Yos 


Thus X and Y are i.i.d. N(0, 1) variates. 
Example 3. Independent variates X and Y, represent 
rectangle, have the densities 


f(x) = 1/10, 100 < x < 110 : hO) = 
Find the p.d.f. of the perimeter of the rectangle. 


[Converse to Example 1(1)] 
ing the length and breadth of a 


1 10 <y < 12; vanish elsewhere. 
2 , 
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Solution. Let U = 2(X + Y), (perimeter); u=2v+200 j =2v + 220 


V=Y, so that X = 1U – У, У = V. Then 


O(x, y)/O(u, v) = 
g(u, v) = 1/40. 

S = [G5 у): 100€ x « 110; 10€ y € 12) transforms to 
T = {(u, v) : 200 < u —- 2v < 220 ; 10 <v < 12} о 


The parallelogram T in u-v plane can be split 
into three parts A, B, C as shown. Hence 


; fx, y) = 1/20 transforms to 


м [— 


а dy a-10_u—220 <n<224 
g,(u) = Ie. Freie NK 220 <и < 
24у l 
go) = „лр? 224 < u < 240 
dy 12-b 224-u nd 
a0) = ] 2 -- о MO sue 2. 


Problems with Solutions Provided at the End of the Text 
1*. The joint p.d.f. of variates X and Y is 


Дх, у)  Axye +”, x20, y20; f(x, y) = 0, elsewhere 
(a) Are X and Y independent ? Find the conditional OAM of X given Y - y. 
(b) Prove that the density function of distance u = ee +Y 1277 is 


g(u) = We" ,0xu«o;  g(u)-0, elsewhere. 


2*. Independent variates X and Y have the p.d.f.’s 


feos (п 41-x^)",dxl«l; gQ) 2 ye, ухо. 
Find the joint p.d.f. of 7 = XY and W = X. Hence or otherwise find the density of Z. 


3*. Let (X, Y) ~ Dirch (a, b, c). If X = Z and Y= T(1 ~ 2), find the distributions of 7 
and Z. Let U, V, W be indep. y% y(m), y(n) variates. 


If P= UU + V+ №), Q = V(U + V + W), then (P, О) ~ Dirch (1, m, n). 
4*. Let fix, у) 2kx £y) ;0«x«1l, 0<у<1, О<х+у<1. 
Find f,(x) and obtain the joint and marginal distributions of X + Y and X — Y. 
Exercise 4(c) 


1. Find the p.d.f. of X + Y, when the joint p.d.f. of X and Y is 
f(x, y= lae", 0<х<2,у>0, f(x, y) 20; elsewhere. 


i. d 
[Ans. f(u)=>(u-l+e “YIO<us2)44 (1+ e?)e"" I(2 <и < %)]. 
2. Find the p.d.f. of Z = X/Y, if X and Y are M independent random variables such that 
fo) = Ae", x 2.0; 80)- ue" y». 


[Ans. f(x) = (WA) [z + (wA ] >.<? 0 


3. 
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Exercise 4(c) Mu linda 


If fix, y) = (/x)) KI x1» 1). КО < y S 1), show that the distribution of Q = X/Y is 
-2 = ur. 
fo(D- (C +1) а Д) (2 г?у1(> р), 


4. Variates Х and У are jointly distributed as follows : 


10. 


E. 


fic y) = 2(a^ — x! — уута“ 0 « x? + y < а?. 
(a) Show that the marginal distribution of X is 
йух) = 8(а? - х2)23 па“, -a Sx <a. 


(b) Show that the joint prob. distribution of r = |x? + у and Ө = tan! (y/x), 15 


P(r, Ө) = 2r(a° – r’)/na’, 0€ r<a,0<0<2n. 
(c) Show that the p.d.f. of Ris A(r) = 4r(a? — г2)/а* 0 <r « a. 


? 2 


(d) Show that the joint distribution of X and K whete k= IX Y is 


8(x, г) = 4r(a? - rae? - х?)а*, 0«r«a, -r«x«r. 


. (i) Let X and Y be a random sample of size 2 from a distribution with p.d.f. 


f(x) = Ae, 0 « x « оо; f(x) = 0, elsewhere. 
ў 


Show that X + Y and X/(X + У) are independent. 
(ii) Let X, Y, Zdenote a random sample of size 3 drawn from the above distribution. Show that 
U=X+Y+Z, V2 ХІХ + Y, W=(X+ Ү)/(Х + Y + Z) are mutually independent. 


. If X and Y have the joint p.d.f. f(x, y), find the joint p.d.f. of Z= J/X^ + Y? and W= X/Y. 


. The p.d.f. of (X, Y) is f(x, y) = abe ^ ^" x, y» 0; f(x, y) = 0, elsewhere. 


Find the density function of (U, V) where U = 1 + 2(X/FE); V= 3X Y. 


2b — 
[Ans. g(u, v) = pre Hec I(v»0) I(u»l) 


g(u) = [2ab/(au + 2b — ay] (и > 1)] 
Let X, and X, be two independent determinations of a variate X whose density is 
fix) = alx’, x > a; f(x) = 0, elsewhere 
Show that the p.d.f. of Y = ХХ, is g(y) = (1 ) №0 <у<1) + (2у2у! K(y 2 1). 
If Rx, y) = уе ? K0« x «oo) K0 « y « 1), find the distribution of (i) U = min (X, Y) and (ii) V= max (X, Y). 


[Ans. f(u) = [е7 (2-u ^?) -e"(u? tu) KO <и <1), F(r 20, It x0) + [t4 t^ (e^ —1)] 
K0«t«1) «(1-70 0-65] 2 10) 
If fix, y) = 2e " *? КО € y <x < о), find the distribution of S = X + Y and Q = X/Y. 
[Ans. fz) = ге z> 0) .fo(t) = 201 +) Kr» 1)] 
Variates X and Y have the joint p.d.f. f(x, y), given by 
Ах, у) = g(x + у), x 30, y 20; f(x, y) = 0, otherwise. 


Obtain the c.d.f. H(z) of Z = X + Y and deduce that its p.d.f. is 
h(z) = zg(z), 2> 0; h(z) = 0, z «0. 


| 


1 84 Jointly Distributed Random Variables —  — 
A o NENNEN Li uada ОН diim a 


4-10. Miscellaneous Worked-out Problems Een: 

: "үүт depe › 
Example 1. (i) Show that even if two random variables are not 1nde[ 
functions still can be independent. 


> such that X^ and 
(ii) Give an example of two r.v.'s X and Y that are not independent but suc 
Y^ are independent. 


snaiprobable. Define variates 
Solution. Let О = (a, b, c, d), where all the outcomes are eugiprobable 
X and Y on €2 by the relations 


= 0 = Y(d). 

X(a) = 1, X(b) = 0, X(c) =-1, X(d) = 0; Ка) = 1, Y(b) =-1, №) #0 = Na) 
ik 

Then P(X = 1) = J. = P(Y = 1) each P({a}); and P(X = 1, Y= 1) = PUa}) = 4- 


Obviously : Р(Х = 1; Y 2 1) = Р(Х = 1) В.т 1) > X and Y not indep. 
Now consider the distributions of X? and Р. Let U = x^. Vs Y°, then 


P(Uz0)-izP(Us1);P(VsO)ei-P(Vel). 
Now P(U=1,V=1)=P(a)= 1 = P(Uz 1) Р(У = 1), 
Р(О= 0, V = 0) = P(d) = 1 = P(U = 0) (V = 0), 

p 

n 


their 


РО = 0, Vel) ру = PO IU POIL) 
PUU = 1, V=0)= Р(с) = 4 = Р(О = 1) Р(У = 0). 


This shows that U and V are independent, i.e. X! and Y? аге independent. 
(ii) Let f(x, у) = (1 + xyy4, -1 «x, y < 1; f(x, y) = 0, elsewhere 


Then ЛО) = lf d+xy)dy=+4,1x1<1. Similarly, (у) = +, 1у1<1 


Since f(x, у) € 00) Љ(У), it follows that X and Y are not independent. However, 


Ja pvb э 2 ә 9 ә 
PiX? za, Ý’ <b} = Lore y) dxdy =a" .b'? = P(X? <a). P(Y? < b?) 


It follows that X? and Y? are independently distributed. 
Example 2. Let F(t) be a cumulative distribution function (c.d.f.). 
(i) Is G(x, у) = FG) + F(y), a joint ER 7 
(ii) Is G(x, y) = max { F(x), F(y)}, a joint c.d.f. ? 
(iii) Is G(x, у) = F(x). FQ), a joint bs. ? 
(iv) Is G(x, у) = min (FQ), F(y)}, a joint c.d.f. ? 
Solution. Part (i) : Here G(x, y) = F(x) + F(y) 
G(-«, у) = Fœ) + FO) = G(-o, оо) = F(-c0) + Боо) =0 + I = 1 

Sint G(-0, ©) = 140, [Art. 4-11(4)], G(x, y) cannot be a joint c.d f. 
Part (ii) : Here G(x, y) = max (FG), F(y)) 

G(—9, хо) = max (F(-»)]), F(o) = max (0, 1] = 1 
Since С (о, ©) = 1 + 0, we conclude that G(x, y) is not a joint c.d.f. 


$4-70. Miscellaneous Worked-out Problems _ 2 к 
Part (iii) : Here G(x, y) = F(x). F(y). 
Step 1. Since F(t) is a c.d.f. so O € F(t) < 1 for all t and hence 0 < F(x) F(y)« 1, V x, y 
De. Me Git, y) NR x) 
Step 2. Since F(t) = 0 is monotinically increasing (for all г), hence F(x) F(y) > 0 is also 
monotonically increasing. Thus G(x, y) is monotonically increasing in both arguments. 
Step З. G(—», у) = F(=) F) = 0; G(x, —o) = F(x) F(-oo) = 0; G(oo, оо) = Р(оо) (о) = 1. ...(iii) 
Step 4. We know that F(t) is right continuous, hence 


lim G(x, y) = lim [F(x) . F(y)] = [lim F(x)] F(y) = F(a) F(y) = G(a, у). 


Hence G(x, y) is right continuous in its first argument. Similarly, G(x, y) is right- 
continuous in its 2nd argument. Thus, G(x, y) is right continuous in both arguments. 
Step 5. Now consider the Rectangle Rule : 
P = G(a, c) - G(a, d) — G(b, c) + G(b, d), [а « b, c « d] 
= F(a) F(c) — F(a) F(d) — F(b) F(c) + F(b) F(d) 
= [F(b) – F(a)] [F(d) – F(c)] 

Since F(x) is increasing, so a « b, c < d gives F(b) > F(a), F(d) > F(c), hence p 2 0. 
Also F(b) — F(a) € F(b) € 1; F(d) — F(c) < F(d) € 1, sop x 1. 
Combining these results ; O < p < 1. 
These 5 steps establish that G(x, y) is indeed a c.d.f. 
Puta: Here GG, y).-.min-(F(x),.F(y)). 
en ae cince 0 — F(x), FG), = 1 => 0 < min (F(x), FOY < 1 20s GG, у) s 1. 
Step 2. Let x, > x, then F(x,) > F(x,) because c.d.f. ‘F’ is always increasing. 

G(x,, y) = min {F(x,), F(y)); Сбх, y) = min {F(x,), FQ)}. (A) 
The following three cases arise : 
(a) F(x,) 2 FO) 2 Fœ), (b) F(x,) 2 F(x)) 2 FQ), (c) FY) 2 F(x) > F). 
For the case (a) : G(x,, у) = FO), GGo, у) = Р(х) > GQ, y) 2 GO), у). 
For the case (b) : G(x,, у) = FO), С(х„ y) = FO) > GG, y) = GG, у). 
For the case (c) : Gx, y) = F(x,), С(х,, y) = Fx) 2 GO, y) > GO, у). 
Hence G(x, y) is monotonic in x-coordinate ; similarly it is monotonic for y-coordinate. 
That is G(x, y) is monotonic in both arguments x and y. 
Step 3. G(—», y) = min {F(-~), F(y)} = 0, [^ F(-%) = 0]. Similarly, G(x, —) = 0. 
Also G(co, оо) = min { Е(оо), F(o)) = 1, since F(%) = h 
Step 4. Since F(x) is а c.d.f., it is right continuous. So using definition of minimum; 


Сбх, у) = min (FG), FQ)) = ЕО) + F)]- [lim FG) 7 РОУ) П, 
- lim G(x, y) - 4 lim [FG + FQ) - LFG) - FO) I] = 1L lim. FG) + FQ) TFC) = F(y)l], 


= i[F(a) + FQ) -1F(a) - FQ)1] 7 min [F(a), F()] = GG у). 


НИНЕ 
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Thus G(x, y) is right continuous in x-coordinate. Since same argument holds for 
y-coordinate, we infer that G(x, y) is right continuous. 

Step 5. Now consider the following Rectangle Rule for distribution functions. 


p = G(a, c) - G(a, d) - G(b, c) + G(b, d), for a < bh, pud. Б) 
The following six cases arise : 
(1) a<b<c<d (i) c<a<b<d (iii) c<a<d<b 
(iv) c<d<a<b (у) a<c<d<b (vi) a«c« b « d. 


It suffices to consider any one case, since all other cases behave similarly. Suppose 
we consider (v), then a « c « d « b. Since F(r) is monotonic increasing, we have 
F(a) € F(c) € F(d) x F(b) 
Since G(x, y) 2 min ( F(x), F(y)), use of (2) into (1) provides 
р = min (F(a), F(c)) - min (F(a), F(d)) - min (F(5), F(c)) + min (F(b), F(d)} 
= F(a) – F(a) — F(c) + Еа) = F(d) - F(c) 2 0, [by (2)] 
Thus p = F(d) - F(c) < Еа) < 1, and hence 0 € p < 1. 
All other cases lead to 0 < p < 1. We conclude that G(x, y) is a joint c.d.f. 


Problems with Solutions Provided at the End of the Text 
1*. The following table gives the joint p.d.f of X and Y : 


Are X and Y independent variables ? 
2*. Let X and Y be independent variables with distribution : 
P(X =+ 1) = 1= Р(Ү = £l). Are X and Z = XY independent ? 
3*. Let f(x, у) = КО —х)#,0<х<у<1; Дх, y) = 0, elsewhere, 
(i) For what values of В can k be chosen to make f a p.d.f. ? 
(ii) How should k be chosen to make f a p.d.f. ? 
(iii) Find the individual densities of f. 
4*. Iff, у) = 1,0<х< 1, 0 « y « l, find the density of Z, where Z=X + Y, х+у< 1; 
ZeEk4Y-1,x:€9»21 
5*, The joint distribution of X and Y is Дх, у) = 226“ * Qexe CN 
Find the joint and marginal distributions of X and X + Y. 


6*. 


187 


57572. 


Miscellaneous Exercises 


Given Дх, yIlz) = 2+ (1 – 2) (х+ у), O«x, у<1,0<2<2 and f(z) = 5,0 
(а) Аге Х, Y independent ? 

(Б) Аге Х, Z independent ? 

(с) Find the joint distribution of X and X + У. 

(d) Find the distribution of max ((X, Y) | Z = z}. 

(e) Find the distribution of ((X + Y) | Z= z}. 


Miscellaneous Exercises 


. Show why the function f defined by 


Хх, y) = kx(3x - y), 0< x « 2, -x< y « Ax ; Ñx, y) = 0, elsewhere 
cannot represent a p.d.f. for any choice of k. 


. The joint p.d.f. of (X, Y) is 


(a) f(x, у) = 2(2 – 2x-y),x=0, y=0, y x2 - 2x. Find f,(x) and f,(y). 


(b) f(x, у) = х? «1x 0€ x 810€ y «2. Find PIX >StY 2), P(Y «TUX <4), PUX 9 Y « 1]. 
(c) F(x, у) = 8xy, 0 «& x « y < I. Find the joint density of X/Y and Y. 
[Ans. (a) f(x) = 3(1 — х) K0 < x « 1), f(y) = [302 — )/8] KO « y <2). 
(b) p 2 43/52, (c) Ќи, v) = (и). f(v) = (2и) (4v), O0«u,v«1] 


. The joint p.d.f. of X and Y is given by: f(x, y) = Тху, 0€ y «& x, 0« x «2. 


Find the marginal distributions of X and Y. Are X and Y independent ? 
[Ans. f,(x) = (x°/4) (0 < x< 2), f (y) = [y — (у`/3)] KO « y < 2)] 


- A hand of three cards is dealt with from an ordinary deck of 52 cards. If X and Y are the number 


of aces and the number of spades in hand, find the joint p.d.f. of (X, Y). 


. If fx, y) = (2у/х”) I(x > 1) K0 < y € 1), find the distribution of S = X + Y and T = XY. 


[Ans. f,(t) = 2(t- 1 -in t) КІ $t<2)+2[(t- 1)! г (г 1) ] r2 2) 
ЕД) = (21/3) 0 << 1) + (2/32) (t> 1)] 


. Four coins are tossed. Let X be the number of heads and Y be the number of heads minus the 


number of tails. Find the p.d.f. of X, the p.d.f. of Y and show that P(-2 x Y « 4) = 7/8. 


- Let (X, Y) have the density f(x, y) = 2: for (x, y) inside the square with corners (a, a), (—a, a), 


(a, —a), (-a, —a) and f(x, y) = 0, elsewhere. Find a and obtain the marginal densities for X and Y. 
How the values of a and marginal densities change if the corners of the square are (a, 0), 
(—a, 0), (0, a), (0, —a). 

[Ans. 7,00) =f,(t) =а= V 42 Itl «a; вү()=в,(б=1-1г1,111<1.] 


» Let X,, X, be a random sample from a distribution with p.d.f. f(x) = 2x, 0 < x < I ; zero, 


elsewhere. Show P[(X,/X,) < 1] = $, and Р(Х, < X;1X, «2X;] = 4 
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9. Obtain the marginal d.f.s. of X and Y, when joint d.f. of X and Y is given as follows : 


10. 


14. 


12. 


3. 


14. 


0, х<0 or у<0 

1(I- cos y + sin y), tz472 O<sy<n/2 
F(x, y) 4X1 (1- cos x + sin x), 0€x«n/2; y2n/2 

l[sin x + sin y - sin (x + y), O<x<1/2; 0€ y«n/2 

l, gaz? y&n/2 


[Ans. А0) = 0) = Of(t « 0) + 301 — соѕг+ sin t) 0 57 < 7/2) € 1I 2 2/2) 


Let fix ly) = ky, 0« x « y,0<y<1;f(xly) = 0, elsewhere and 
МУ) = су, 0<у<1; fy) = 0, elsewhere. 
(а) Show that k = 2 and c = 5 and find the joint p.d.f. of X and У. 
(b) Prove that Pii<x<t l|Y = = эу, and Pii<X<4 1) = 29. 
Find the marginal and conditional p.d.f.’s if the joint density is 
(a) f(x, y)=2(2-x-y),0<x<y<1; f(x, y) = 0, elsewhere. 
(b) f(x, у) = ке еы <o. 
2(1 + х) (+ y) 
[Ans. f,(x) 23(1 -x (0 €x € 1), (y) = (4y - 3?) КО « y « 1), 

(b) FO = 500 = [38 + 20/4(1 + tj] I(t > 0); (х1 у) = [6(1 + х + y)/(3 + 2y) (1 +x)1] 

Obtain the conditional distributions when variates X and Y have the joint distributions : 


where 12a=5b. 
Variates X and Y have the joint distribution given in the following table. Find a. 


Show that Р(Х > У) = $ ‚Р(Х? > Ү?) = iP Y«0)z + and (XY » 0) - і i. 


Show that the conditions for the function Дх, y) = kexp (ax? + BE sob 
a bivariate p.d.f. are: a < 0, b <0, ab — h’ > 0. 


Show that, when these conditions are satisfied, mk = (ab — a^^ 
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[Hint. Let x= r cos Ө, y =r sin Ө ; then A(x, y)/O(r, Ө) = ғ. Thus 
flr, Ө) = kr exp (Br’), 0€r«o,0«90 «2n. 
B=acos 0 + 2h sin Ө cos Ө + b sin? 0 = (1/а) [(a cos Ө + h sin ө) + (ab – h°) sin? Ө] 
= (1/b) [b sin Ө + h cos Ө)? + (ab — А2) cos? Ө]. 


The Improper integral [ гей" dr is convergent iff В < 0. 


This holds iff a < 0, b <0 and ab — h° > 0. Put B = А, (A> 0). 
Use normalization to obtain the value of k; thus 


a „Фе... 
is 240 acos? Ө + 2h sin Ө cos Ө + b sin? 0 
Put tan 6 = z and evaluate. The cases a = 0, b = 0, ab = h? may be discussed separately] 
15. Two discrete variates X and Y have the p.d.f. 
(i) p(0, 0) = 2/9, p(0, 1) = 1/9, p(1, 0) = 1/9, p(1, 1) 2 5/9. [р(х, y) = Р(Х =x, Ү = у)] 
Show that X and Y are not independent. 


(i1) p(0, 0) = p(0, 1) = p(1, 2) = = . Find Fy, F F(x, y). Show that point -1 , 0) is a continuity 
point and point (0, 1) is a discontinuity point of F(x, y). 
16. Suppose X and Y are two variates where Y is degenerate. Show that X and Y are independent. 


17. If X and Y are independnet, absolutely continuous variates, show that their joint distribution 
is also absolutely continuous. 


18. Let X and Y be independent variatets with P(X 2 0) = 1 = P(Y 2 0). 
Are (i) P(XY < 6) = P(X < 2) P(Y $3), (ii) P(XY < 6) 2 P(X <2) P(Y <3) true ? 


19. Consider two events A and B such that : P(A) = Š ,P(BlA)- T Р(А 1 В) = 1 . Define the 
variates X and Y as under : 
X=1,ifA has occurred ; X = 0, if A has not occurred ; 
Y= 1, if B has occurred ; Y= 0, if B has not occurred ; 
Now comment on the following statements : 
(а) X and Yare independent (Ы) Р(Х += 1) = 1, P(XY 2 X'Y^) =1. 
The joint p.d.f. of X and Yis: flx,y)= ze 9 уз, у> 0; fix, y) = 0, elsewhere. 
: Find (i) the p.d.f. of Z= XY, (ii) c.d.f. of W= max (X, Y). | 
i [Ans. f(z)=e*,z>0; F(w)=(1- e™)+ (1 +w)" [е7 – 1], w>0] 
21. If fix, y) = 4xy, О < x, y < I, find the joint density of X? and У. 
. 22. (а) Variates X, Y, Z have the joint p.d.f. 
fu. y,2= 12x)yz, О <х,у,2<1; foo у, 270, elsewhere. 
Find marginal densities of X, У, Z and the joint p.d.f. of X and Y. 
What is the conditional p.d.f. of X and Y given Z = 20 0«2,« I. 


Also, show that Р(Х < Y)» 2, PX « Y« 2 - з;. 
(b) Efx, у, 2) = 8xyz, 0 € xX, у,2< 1, show that P(X < ¥<Z)= É 


p^ 


s 


1 90 Jointly Distributed Random Variables 
23. 


24. 


25. 


26. 


27. 


28. 


Let X, Y, Z be i.i.d. variates from a distribution having p.d.f. fo) = 5x^,0« х < 1, fix) = 0 
elsewhere. If W = max (X, Y, Z), show that F(w) = w^ КО « w « 1) and find p.d.f. of d 
If fx, y) 2 e ** 9, 0 « x, y< ©; show that the joint density of X and X + Yisg(u,v) =е ,O<v<y 
« oo, 
If Дх, y) = 2G + y - 3xy^) 0 « x < 1) (0 < y < 1), find the distribution of M = max (X, Y) and 
М = min (X, Y). 

[Ans. fy(t)= 10902 —5:*) 10 «1« D), Душ) = 2+ 21-97 + 5t*) I(0 « t < 1)] 


If fix, y, z) 2e  *"*9. 0< x, y, z «oo; show that the density of W = 4(X +Y + Z) isg(w) = (27/ 
2)w/e^". у> 0. 

Prove or disprove : 

(a) If Y X +1, then F(r) = Fy(t+ 1) for all t. 

(b) If Fy(t)> F(t) for all t, then P(X < Y) > 0. 

The function ф(х) is monotone increasing and Y = ф(Х). Prove that F(x, у) = F,G) Ку > 600) 
+ Еу) I(y < ф(х)). What happens if ф(х) is monotone decreasing ? 


To live for some future goal is shallow. It's the sides of the 
mountain that sustain life, not the top. [Robert Pirsig] 


sjeieteieieteieieieieieieieiejeieieieimiieiie nene ie ОТООР 


Blind fortune still bestows her gifts on such as cannot use them. (Ben Jonson) 


Mathematical Expectation 


5-10. Mathematical Expectation 


1. Let X be a discreate random variable defined on a probability space, and let [x,] be the 
countable set of its possible values, such that P(X = ху) = р. The mathematical expectation 
of X, (or the mean of X), written E(X), is a real number defined by the kernel-sum 


E(X) = Xp,x, for all i (kernel definition) (1) 
provided that the series У р, 1 х,1 is convergent. 
2. Let X be a continuous r.v. with p.d.f. f(x). If the integral 


| о) х1ах <o 


(i.e. convergent), the expectation of X, written E(X), is the real number defined by 


E(x) = [^ f(x) x dx. NT 
Comments. If the series (1) or integral (2) is conditionally convergent, E(X) does not 
exist. The absolute convergence of the defining sum (1) or integral (2) for the existence 
of E(X) is pre-requisite. Thus, E(X) exists iff E(I X 1) exists. 
Note : If the values х; (and hence the corresponding р, as well) are listed in a different 
order, the infinite sum LP; may change its value although the r.v. X remains the 
same. Hence it is but natural that we insist on the absolute convergence so that 
rearrnagement of series Уру, does not alter its value (sum), yielding unique value of Е(Х). 


Warning Problem. А г.у. X takes the value x, = (-D* 2^ /&,1< К< о, with probability 
p, = 2^. Find E(X). 
Solution. We emphasize that E(X) « v iff E | X | exists. Here 
72. grt ^L 
E( X 1) = 2ч k , k 2.3 e 
This is a well-known harmonic series which is divergent. Hence E(X) does not exist. 
Let us note the blind-folded attack : 


Е(Х) = Scat! Qo 0%) = XICD HI Pg “W 


be conditionally convergent. If 


This is alternating harmonic series, which is known to ent. 
: examine (1) by rearranging tts 


E(X) exists, it should have a unique value. However, 


É terms. Let it be E, (X); then 
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саада. 
Thus, E,(X) # E(X). This is the reason that insist on absolute convergence for the 
definition of E(X), so as to get its unique vlaue. 


Observation. Let h(X) be a function of the random variable X and set Y = A(X). To find 
E[h(X)], i.e. E(Y) we require the distribution function of Y; so 


E(Y) = Ly,P(Y = y), if Y is discrete; EQ) = f. wf, ) dy if Y is continuous 


where we assume the knowledge of the distribution of Y. 


As a matter of fact, there is no need to derive the distribution of Y and we show in 
Art. 5-12 (LUS), that 


E[^(X)] = Eh(x,)P(X = х,), V x, if X is discrete; E[h(X)] = [^ CO fx) dx, if X is continuous. 


Note. On intutive grounds, we explain why 
do we require the absolute convergence of the 
series in (1) or integral in (2). Suppose X is 
continuous with p.d.f. f(x) = 0. Then xf (x) = 0, 
if x 2 0 and xf(x) < 0 if x < 0. The graph of 
y =xf(x) might be as shown in the adjoining 
figure. Let A denote the area which lies above 
the curve y = xf(x) and is bounded above by 
the x-axis and let B denote the area which lies 
under the curve y = xf(x) and is bounded below 
by x-axis. Then, by the geometric meaning of 
definite integral, 


(i) [^ xfG) dx = В- A, and (ii) f^ xl f(x) dx = B+ A. 


There are four possibilities : 

(a) B=@,A = %, (b В= о, 0 <А < о, 

(с) О < В< о, А = о (d 0< В<о, О < 0A < o. 

Іп cases (а), (b) and (c), we see that В + A = © and В — A is not a finite number (оо — oo 
is indeterminate). That is, integral (ii) is oo and integral (i) does not exist. In case (d), 
A + B and B — A are both finite. Hence, integral (i) is defined whenever integral (ii) is 
finite (<оо). 
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5-11. Geometric Formulation of Expectation 


If F denotes the distribution function of a continuous r.v. X, then 


EX) = f, t - Foo] dx - f^ F(x) d= f Fa) dx | Fa) ах 


provided the integrals exist finitely. 
Proof. Let f be the density funciton of r.v. X. We may interpret f(x) dx = dF(x). Now 


EOD = ds. zx) dx = h xd F(x) + [ xd НО) ne xd F(x) — le xd [1 — F(x)] 


= [xF(x)]),, - ha F(x) dx — {х[1— Е(х)]} + {0 —F(x)|dx.  [Integ. by parts] 


Now lim a[l- F(x)]= lim xf" 4F() dt < lim |” tdF (1) - 0. ПЕ) 


The integral above tends to zero as х > оо, 
because it is the tail of a convergent 


integral. Simiarly, lim x F(x)=0. Hence 
X—-—00 
the above result reduces to 


EQ) = ['ti- Feo]dx- |? Е) а. (р) 


Note. The geometric content of Eq. (1) 
isu = E(X) = Area B — Area A. 


Also | E(X)= [P(X >) |? РОХ) а | O) 


For the integer-valued г.у. X, Eq. (1) becomes 


E(X)- Ый ZEROS È Fy(-K) aR) 
k=l k=0 


An Alternative Proof. Let f(x) be the p.d.f. of X. 
frt - Feogdx = [Pac odc- [f f04))as 


= L f(y) ({ dx) dy Interchange limits in region A) 


= |S yf) dy. 
[Pa sx) dx- MIN fo) dy) dx 


f. reo dx 


f f) (fax)- - o (у) dy (change of order in region B) 


oo 0 
E(x) = [^ sf dt = го) + |0) dv - |, 1 - FON- [Foo ax. 


Cor. 1. If X is non-negative г.у. with c.d.f. “Р”, then, Е(Х = INI — Fo)]dx- j P(X > x) dx. 


Cor. 2. If X is non-negative integer-valued variate, then E(X) = Y, P(X 2 j). 


j=l 
A direct proof of Cor. 2 is much more illuminating. [See Ex. 5.4(a)] 
Note. For a variate, which is partly continuous and partly discrete, we use Art. 5-11(1), 
where geometric interpretation of E(X) is given. 
For illustrations of Cor. 1 and Cor. 2, we may find E(X) for expo (A) and gem (p). 


5-20. A law of Unconscious Statistician (L.U.S.) 
Let X be a r.v. and h be any real-valued function of X. Then 


E[h(X)] = E,h(x) р(х), [pQ) > 0 is p.m. f. of discrete г.у. X] zo 1) 


= f ha Ло) ах, [f(x) is p.d.f. of continuous г.у. X] ...(2) 


We unconsciously use density of X instead of the density of Y = A(X). 


Proof. (1) Let X be discrete and suppose X assumes a finite number of values. Let h, 


1 <i< n be n possible values of A(X). For reach i, 1 <i € n, let x; denote the values of 
X such that h(x;) = hə 1 <j < т. Then 


PIW =h) = LP = лу) DFC) 
ј= ј= 


п 


Блох) = DA РАО) =] = у) Ло) = SG) Fy) = Ei) fa). 
i= = = ; 


= J= 
If X assumes countably infinite values with positive probability, properties of absolutely 
convergent series allow the same conclusion. 


(2) Let X be continuous. The geometric content of E(Y) is 
x 0 © о 
EQ) = ft - Fool» - f „FO dy =|; PY > ») dy - f? PO « y) ay (ii) 
Replace Y by A(X); denote the sets : A, = (х: h(x) > y}, B, = (x: A(x) < — y); then (ii) provides 
EAO] = f; PAOO > у) y |, PIRX) <- y}dy 
fo av f, fen dx | dy |, fa) dx 


j feo dx [dy - f, Fla) dx ау 
года | dy- f, f G9 dx [ray 
по) FO) da + | по) f) dx 


= | һо) Ло) dx 


У = -h(x) 


h(X) < -Y 


(Interchange limits) 


[4 U B, = к= (o < x < оо} 
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5-21. Illustrations of the L.U.S. : Two-way Expectation 
Qn. 1. Let Y = sin X where X ~ U(0, 7/2), i.e. f(x) = 2/n, 0 < x < 1/2. Compute E(Y) by 2 ways. 


Solution. (i) E(Y)-E(sin б=[ = А = sin xdy- [L.U.S. method] 


sin! y 2 


Gi) 20) = PY < y)= P(sin X < у) = P(X < sin ‘y= |, "х= sin (y). 


Ay) = FLO) = 2inJi-y’, 0<y <1. 
E 


EY) = fy. Ady Torah sino dd ==. [y = sin 0] 


Thus, E(Y) evaluted by two ew ways has the same result. 
Qn. 2. Let Y = е" where X ~ U(0, 1), ie. f(x) = 1, 0 < x < 1. Compute E(Y) by two ways. 


Solution. (i) E(Y) =E(e")= [1 we’ dx=e=1. [L.U.S. method] 
(ii) O E PW xy) = P(&* < у) = P(X < logy) = n "1dx - log y. 
f) = Fy (у) = (17у) Is yse 


EY) = [ fo). y dy - | dy - e-1. 
Thus, E(Y) evaluted by two different ways has the same result. 
Qn. 3. Let Y = X? where X - bin (2, 1/2). Compute E(Y) by two ways. 


Solution. E(Y) = Е(Х?) = 0 .4+ $82 d$ |p- io - (2 d 


bey = 55, then g(0) = 1/4, g(1) = 1/2, g(4) = 1/4 and E(Y) =0. (1/4) + 1 (1/2) + 4(1/4) = 3/2. 
Theorem. If F is the c.d.f. of a r.v. X and E(X") exists, then for any a and 1 < k € n, 


42) 


E(X - af =k | Œœ а) 1 Fool dx -k [о a Foo ах 


Proof. Let f be the density function of X and interpret f(x) dx = dF(x). Now 
EX - a* = [^ (x-a* Ро) а= [| (к-а) аР) f -a* dil- Fœ) 
= [(x- a FGyl^, -f Fod -a - {оа Ро) + t - FO doc - a» 


lim (x- us је dF(t) < lim |, (t — а)‘ dF(t) = 0 


x — œ, because it is the tail of a convergent integral. 
_o. Hence the above result reduces to 


Now lim (x - ay n-F (x)] = 


The last integral tends to zero as 
Similarly, (x — а)“ F(x) > 0 as x > 
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E(X - a = kf (x-a) F(a) dx - kf" xay Foo dx. 


Cor. EX - [xn - Foo] dx - [^ a^^! FQ) dx] “ү 


а 


Б) 


EQO* =k [x I- Fea) + (CDS (de 


Note that (ii) follows from (1) by using x = -t in 2nd integral in (i) and then changing 
dummy г to dummy x. 


5-30. Some Important Properties of Expectation 
Let X, Y be random variables and a, b, c, be constants. Then for regular functins g, Л, 


it) Ee)zc [Constant-invariance] 

(п) Е(аХ + Б) = aE(X) +b 

би) РЕ Ее) = ITS EX) =e [Degenerate variate] 

пу) Fia<AX So; = 1 >a SEAS [Certainty Limits] 

(v) Efag(X) + bh(X)) = aE(g(X)) + bE(A(X)] [Linearity] 

(vi) Е(Х) = От Е [X is non-neg integer-valued г.у.] 


(vii) E(X -a)* = kf œ- a" t - FQ) dx К] Gc - a)! F(x) dx 


(viii) E(ag(X) + bh(Y) + c} = aE[g(X)] + BELAY) + с, [Linearity ($5-51)] 
The linear property of E shall be coded : Lin E. 


Proofs of Some Operational Properties of E 


(i) Treating X = c as a Degenerate r.v. that assumes its only possible value c with 
probability 1, we get 


E(x) ecc. PA me) nl =: [X(@) = c, V o є О] 
(ii) Suppose X is continuous with p.d.f. f(x), then 
Elag(X) + bh(X)) = [ [ag(X) + bhOO] fx (x) dx [by Def.] 
= ај” «Ол (x) dx + bf” W(x) fy (x) dx = аЕ Ху] + PE[RQO] — 


If b = 0, this result gives E[bg( X)] = bE[g(X)] 


Cor. E(aX + b) = aE(X) + b. 
Replace g(X) by X and A(X) by 1 in (i) to get the result. 


$5-31. Worked-out Problems 197 


More Properties 
1. If X 2 0, then E(X) > 0. 
Proof. Assume X is absolutely continuous. Since X is non-negative, f(x) = 0 for x < 0. 
Hence, provided E(X) exists, 
EO = | хо) dx =|, xf(x) dx » 0 
2. The expected value of a bounded r.v. X always exists. 


Proof. Assume X is absolutely continous and bounded, i.e. | X | < B, so that f(x) = 0, for 
x » B. Now 


o0 B 
B xlf(x)dx = |! хі f(x) dx < B|” ғо) dx = B. 
If X is discrete and bounded, i.e.l X; | < B, Vi, so that p; = 0, for | x; | > B, then, for all i 
Xx! p; < B(2p,) = B. 
Thus, in either case, E(I X; I) < B, whence expectation necessary exists. 


3. Relation between E and P. Expected value of an indicator variate E(T,) = P(A) 
Expected value of an indicator variate X = /, is given by 


BU = I. P(I, =1)+0.PU,=9)=PCU, =)= P(A)= f dF) 
This result is valuable, since it is frequently used to find P(A) rather than to evaluate E(X). 


5-31. Worked-out Problems 
Example 1. If the possible values of a r.v. X are 9, 1, 2, 3, .., then 


(i) Е(Х) = ХР(Х> п), п = 0, 1, 2, 352 th) 
d) YAPO» k) = HEX?) -EOOI. Rn 
k=0 


Solution. (i) We assume that the series YP(X > x) is convergent. Now, using Р(Х = k) = 

p, we observe that 
P(X > 0) = P{(X = D Ы (X=2)0 (Х= 3) О...) Spy t Pot Pst 
P(X > 1) = Р{(Х = 2) U X23 © (Х = 4) Ы ...} = рә + P3 + ра te 
Pu Уер: t prt P; ton PUSS hy = Py К Pkr t e 

and so on. Adding all these terms, we get 


BE лаша» ROL a Dé Re DAS Bi 29. * poe Ap +. 
n=0 


iz Y Ap, zE(X). 
k 


T1 


n both sides of (1) are equal to oo. 


Note. If E(X) fails to exist, the | 
ЖАР = |. We may also put P(X = j) = Рр 8° 


(ii) Since k = 0 yields zero term, we commence with k 


Ў 6: Ead уриаг = Es 
YkP(X»k)2 Xk У ру = LP; ари р; У јр | 
k=] k=l J = 


К] 


= i[EQC) - ECO]. 
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Example 2. Gambling system (Bold Play) : ^ fair coin is tossed. If уч p you 
win Rs 1. If г occurs, you lose Rs 1. If you win, you quit. But if you lose, ^ double 
your bet so that on the second toss you either win Rs. 2 or lose Rs. 2. You continue 
playing in this manner, quiting the moment you win and 
lose. Since your bank-deposits is finite, you can afford at most л à 
your winnings (or losings), evaluate E(X). 

Solution. О = (h, tyhy titans tite fn- Л» tito ee i | 

X(h) = X(t hy) = ХА) =. m X, t, A) = | (ваш) 
Eon) = ЗЧ ОЕ (L068) З 

Kies t) + 2' 4. +2 о Оа) 07-02 = 1 [general term] 
f(x) = Prob. of losing = P{t, ... t,} = 1/2": Prob. of winning = | pum. 
f = 1 = (1/2)"; £2" 1) = (1/2). (pm.£) Е(Х) = 1[1 - 0/2] + C27 + D (0/2) = 0. 


Note. lim f,(1) 21, so winning Rs. 1 is almost certain. 
no» 


doubling your bet if you 
ttempts. If X denotes 


Problems with Solutions Provided at the End of the Text 


l*. Prove that the mean is not defined for each of the following random variables : 
(a) fix) = Wasa = 2 луг 293,38 


(b). f(a) = 24.) 52; 5 GIB d dius 
(c) Aix) = l/x(x + 1), x 21,2, 2.5 f) 0; elsewhere 
(d) fix) = I/( + 1,0 «€ x « o. 
(e) f(x) = 1/л(1 + x’), —o < x < © [Cauchy density] 
2*. Show that, for a random variable X, E(X) exists if E(I X 1) exists and in this case 
PETS EY). 
3*. Let Xj. X... X, be. i.i.d. variates.ang pits) = МЕХ E X,. 


Find (9! ECS, 7S, )s 010) "EGGS, oy, noe 
4*. If X has p.d.f. f(x) = е‘, x > 0, find E(Y), where 
Y='X, А Ыз Y=2k 3 ГҮ =з! 
; 5*. If F(x) is the c.d.f. of a continuous variate X defined for 0 < х < b « oo, prove that 


E(X) = f'Il- Foo dx] 
6*. Let Х|, X» ..., X, be 1.1.0. integer-valued variates with PX = kb p 
* 


Let r, = ln and Y = min {X,, ... X, ). Show that E(Y)- Y (r,)". Evaluate it 
nz] 


when X; ~ gem (p). 
7*. А jar has n chips numbered 1, 2, ..., п. A person draws а chip, returns it, draws 


another, returns it and so on, until a chip is drawn that h 
as b | 
Let X be the number of drawings. Find E(X). s been drawn before 
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g*. If ar.v. X has possible values Xi X2, 2, X, Where x, <x, 1 sixn-]l|,then 


E(X) = Z(x, – xi.) P(X 2 xj), (xy =0) 


+ |? 


Another variate Y has the same set of values as X and additionally satisfies 
Pix & x) 2 PCY > x), for all x "i 
Show that E(X) 2 E(Y). 
pu Let a,, à», ..., a, be arbitrary real numbers and Ар, Pigg. тл be events. Show that 
n n 


2, Laa; P(A,A;) > 0. 


i=l j=l 

10*. Variate X has p.d.f. ‘f’ : f(x) > 0 at x =-1, 0, 1 and f(x) = 0, elsewhere. (i) If (0) = 5, 
find EQ). (ii) If (0) = 4, E(X) = 1/6, find f(-1) and f(1). 

11*. What is the mean number of face cards obtained in a Bridge-hand from a well- 
shuffled deck ? 

12*. A coin is tossed until a head appears. What is the expectation of the number of tosses ? 

13*. What is the expectation of the number of failures preceding the first success, in 


^occ 


in each trial ? 
14*. An urn contains л cards numbered from 1 to n. Two cards are drawn at a time. 
Find the mathematical expectation of the product of the numbers on the cards. 


15*. Find the expected value of Y = (X - 1)", when variate X has the p.m.f. give by 
X 0 1 2 3 
р(х) : 1/5 1/2 1/24 1/8 
16*. If X,, X,, X, are i.i.d. О(0, а) distributed, find E[1 – (Xlaj? where X = min (Х|, Х,, X3). 


5-40. Expectation of a Variate Conditioned by an Event 


Let X be a variate on a given probability space (Q, F, P) and A an event with P(A) > 0. 
The conditional expectation of X, given that the event A has occurred, is denoted by 


E(X | A), and is defined by 


E(X1A) = E(XI,)/P(A), | [P(A) > 0] Wir 
Note that, E(XI,) = 2x,P(X = x) Wu BA. 50 (1) can be expressed as 
E(X1A) = Ух, Р(х)/Р(А), x, € A "We 


5-41. Multi-Stage Rule for Expectation (Multistage E-Rule) 


If A and B are possible events and [P(A U B) > 0] then 


P(B)E(X1 B) - P(AB)E(X1 AB) 
РЕ: OUD 0) 


Proof. Write C, = (X = x} and Р(С, | H) — fix | Н). Now 


РІС, N(AUB)} _ PIC,AUC,BI 
falAQB) = —pAUB Р(АОВ) 
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P(AU B) 
_ ІР(А) f(x 1A) + P(B) f(x1B) - P(AB) f(x 1| AB)] 
P(AU B) 
E(X I A U B) = Exf(x 1A U B) (over range of x-values) 
P(AU B) 
_ P(A) E(XI A) + P(B) E(X1 B) - P(AB) E(x| AB) 
P(AU B) 

Cor. 1. If A and B are disjoint, P(AB) = 0, and we obtain 

E(X 1A U B) =[P(A) E(X | A) + P(B) E(X | B)/P(A U В). 
Cor. 2. Total-E Rule. If A,, A,, ..., A,, ... constitute a Partition of О, [9А, = N] then 


Д1 = > PCA) E(X 1A) 2 E(X) = EF(A)E(X1A,). [XIN =X] 
Cor. 3. Multistage E-Rule 
For a r.v. X associated with occurrence of event AorA. 
E(X) = P(A)+E(X1A)+ P(A)E(XIA) 
Proof. Write Cy = (X =x}, P(Cy) = P(X = x) = f(x) say. Then 
fix) = PRONA U A)}=P(AC, U AC,)=P(AC,)+ P(AC,) 
P(A) PIC, |Al+ P(A) PIC, 1A) [P(C, 1A) = f(x 1 A)] 
E(X) = Xxf(x) = P(A) Exf(x 1 A) + P(A) Ex .f(x1A) 
= P(A)E(XIA) + P(A) E(XI A) 
Extension. If X is associated with occurrence of events A,, ..., A, where UA j = 5; then 
E(X) = P(A) E(X IA) + P(A,) E(X 14;) +... + P(A, E(X | A, ) 


5-42. Worked-out Problems 


Example 1. A man wins a rupee for head and loses a rupee for tail when a coin is 
tossed. Suppose that he tosses once and quits if he wins; but tries once more if he 
loses on the first toss. What are his expected winnings ? 


Solution. We shall use Multi-Stage Rule; define events : A = (H,), = (head on first toss); 
B = (T,H,), = (Tail on first toss, Head on 2nd toss); and C = {7,7,} = (Tails on both tosses}. 
If X denotes his random earning, then by Total-E rule 

E(X) = P(A) E(X | A) + P(B) E(X | B) + P(C) E(XI C) (1) 


Assuming coin in unbiased, we have : P(A) = 1, P(B) = 1 P(O = 1; 


Y 
201 


$5-42. Worked-out Problems 
E(X1A) = +1, E(X | B) = -1 + 1 = 0, E(X | C) 2-1- 1 = 2. 
E£X)21.1«1.0«41(2)- 
— Example 2. A rat is trapped in a maze. Initially he has to choose one of two directions. 
If he goes to the right, then he will wander around in the maze for 3 minutes and will 


p 
X then return to his initial position. If he goes to the left, then with probability 4 ihe will 
depart the maze after 2 minutes of travelling and with probability 2, he will return to 


his м position after 5 minutes of travelling. Assuming that the rat is, at all times, 
і y likely to go to the left ог the right, find the expectation and the variance of the 
E of time that he will be trapped in the maze. 

Solution. The geography of the problem is 


m ndi d in the figure. Let X denote the number 
in the maze. We use mgf method and 


ун E-rule. 


) Ele" 1L) PC.) + Ele IR} РСК) 

) = 4, the above turns out to be 
ы jenta 2M(1) - E(e™ 1L) + Е(ех 1 R) Wh 
b. B рр, X93. 1,2 Sr ux 

rym оё = le” pe * 9] - 1e? 4 2 (e"E(e™)} 

E! | Муха. Ее] e"E(e^). 


; urning to right (say), the rat spends 3 minutes and reaches the initial 
E ry de to start afresh, again with X minutes further captivity. 


mtus. 


f, 
АЈ 
2 


lino (1), collect the terms to get 


= 34") Ж | АХФ) 
Fed wae ш 7; Р „6 


Bi 
^ t! utei «^ 
IIa s. o. - 
ч DEL 4 


nv 


1 me me vert 


2 02 Mathematical Expectation 


BL LLL OO  — 


Exercise 5(a) 


. (a) If P(X =x) =1/5,x=1,2,..., 5; find E(X +2)’. 


(b) A variate X has the probability distribution : f(-3) = 1/6, f(6) = 1/2, КО) = 1/3. Find E(X), 
E(x’) and using the law of Expectation, show that E(2X + 1)? = 209. 

(a) n people, including A and B, stand up in a random order in a (1) row, (ii) ring. Find the 
expected number of people between A and B. 

(b) A contractor is to choose between two jobs. The first promises à profit of Rs. 1,20,000 


with a probability of + or a loss of Rs. 30,000 due to delays with a probability of 1/4, 


The second job premises a profit of Rs. 1,80,000 with a probability of = ога loss of Rs. 45,000 
with a probability of +. Which job should the contractor choose so as to maximize his 
expected profit ? i [Ans. Job | is preferable] 


A and B throw one die for a prize of Rs. 44, which is to be won by the player who first throws 
a 6. If A has the first throw, show that their respective expectations are 24 and 20 units. 


their expectations ? [Ans. 4, 3, 2, 1] 


A man draws 2 balls from a bag containing 3 white and 5 black balls. If he is to receive Rs. 10, 
for every white ball which he draws and pay Rs. 5 for every black one, show that his expectation 
is 5/4. 


. A lot of 10 items is totally rejected if two items chosen at random from the lot contain | or more 


defectives. Otherwise, it is accepted. Each item costs Rs. 700 and sold for Rs. 900. If the lot 
contains 2 defective items, what is the manufacturer’s expected profit ? [Ans. Loss of Rs. 1400] 


. A player tosses 3 fair coins. He wins Rs. 8, if three heads occur; Rs. 3, if 2 heads occur and 


Rs. 1, if one head occurs. If the game is to be fair, how much should he lose if no heads occur Я 
[А п. Rs. 20] 


8: A makes a bet with B of Rs. 9 to Rs. 6 that in a single throw with 2 dice, he will throw 7 before 


Ж. 


10. 


11. 


12. 


B throws 4. Each has a pair of dice and they throw simultaneously until one of them wins, 
equal throws being disregarded. Find B’s expectation. BE Loss Re. !] 
Ajay plays two games, in each of which his probability of winning is p. If he loses, he loses his 
stake, but if he wins he gets double his stake. How should he divide his fortune between the 
two games to maximize his expected gains ? 

[Ans. Expected gain is indep. of the manner of subdivision of fortunes] 


In a game of chance, a man is allowed to throw a coin indefinitely. He receives Rs. 1, 2, 3. .- 
if he throws a head at Ist, 2nd, 3rd, ... trials respectively. If the entry fee to participate in the 
game is Rs. 2/-, show that the expected value of the net gain is zero. 

You play a game as follows : You pay Rs. 2 and toss a coin. If it lands heads, you are paid 
Rs. 11, otherwise you pay Rs. 4 more and roll a die. If the die shows 1, you are paid Rs. 12; if 
it does not, you pay Rs. 6 and draw a ball from an urn containing 2 black, 2 white and 3 red 
balls. If you draw a black or a red ball, you are paid Rs. 9, otherwise you pay Rs. 8. Find the 
expected pay off. 

A bag contains л white and 2 black balls. Balls are drawn one by one without repalcement. 
until a black ball is drawn. If 0, 1, 2, 3, ..., white balls are drawn before the first black, a man 
is to receive 07, I^, г ЭЙ 3°, ... rupees respectively. Prove that his expectation is n(n + 1)/6. 


13. 


14. 


15. 


16. 


17. 


18. 
19. 


20. 


21 


22. 
23. 


24 


25 


26. 


27 
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A person draws cards one by one from a pack until he draws all the aces. How many cards may 
he be expected to draw ? 

(Ans. E(X) = КУХ - 6x + 11x? – 64x), К = 4/52.51.50.49; 4 < x € 52] 

A game is placed as follows : A number is drawn at random from { 1.2. 3, 4, 5, 6; 7). If the 
number is even, the player wins the number of rupees equal to the number drawn, otherwise, 
the player pays Rs. 3 and rolls two dice. If the sum is not 6, he pays Rs. 6; if the sum is equal 
to 6, he gets Rs. 12. What is the probability that he will make money if he plays once ? What 
is his expected pay off ? 

An urn contains 100 tickets each bearing exactly one of the numbers from | to 100, no 
numbers being used more than once, A ticket (x) is drawn and its number noted. If |} <x € 20, 
the drawer loses Rs. 5. If 20 < x € 35, the drawer earns Rs. 3. If 35 < x < 95, the drawer earns 
Rs. 10. If x 2 95, the drawer earns the amount equal to that drawn by him. If Z represents the 
earning of the drawer in a single draw, show that E(Z) = 97.62. 

Thirteen cards are drawn from a pack simultaneously. If the values of aces are 1, face cards 10 
and others according to their denominations, show that the expectation of the total score in 
all the 13 cards is 85. 

Two players A and B alternately roll a pair of dice. A wins if he gets 6 points before B gets 7 
points and B wins, if he gets 7 points before A gets 6 points. If A takes the first turn, show that 
the probability that B wins is 31/61 and the expected number of trials for A to win is 6. 
Show that the expected number of throws of a coin necessary to produce 3 heads is 6. 

Let the p.d.f. of X be given by : f(x) = l/(x log 3), 1 < x « 3; f(x) = 0, elsewhere. Find E(X), E(X"), 
Var (X), Var (X^) for any positive integer n. [Ans. E(X^) = (3 — 1)/k log 3, use k = 1, 2, n, 2n] 
Let X be a continuous variate and F be its c.d.f. 

Show that E{[F(X)]"} = (n + 1)’, and that E[2F(X) - 1] = 0. 

Shwo that E(X) = 17/6 when X is a random variable with p.m.f. 

P(X =n) = Qn + 1)/[п(п + 1)]?, n= 1, 2, 3, ... 

The p.m.f. of a variate X is: P(X = n) = 6/x n^, n= 1, -2, 3, -4, ... Does E(X) exist ? 


Exercise 5(a) Tm 


A discrete variate X assumes three values —3, 0, 4 and P(X = 0) = 1 апа E(X) = 9/8. Show that 


P(X = —3) = 1/8, and P(X = 4) = 3/8. 
Let f(x) = (1 + x 6,0 € x <2; f(x) = 0, elsewhere. Let n be a non-negative integer. Show that 


E(x" 1X < 1) = (4/5) [(п 1)! + (n 4)! and 


E(x” 1X > 1) = (4/9) [Q"*! - 0/( 1] - IQ"** —1)/ (л + 4)]J. 
Discrete variates X and Y have the same finite set of possible values and E(X) = E(Y) = m. If for 
every possible value и, Р{! Х-ті> и} €P(IY-ml|zu), (i.e. Xis more concentrated about т 


than Y], show that oy <oy. 

Let p, (0 < p « 1) be the probability that a child is a son. Show that the expected number of 
sons in a family with л children, given that there is at least one son is пр(1 -q ). 

A gamester has a disc with а freely revolving needle. The disc is divided into 100 equal 
sectors by thin lines and the sectors are marked 0, 1, 2, ..., 99. The gamester treats 5 or any 
multiple of 5 as lucky numbers and zero as a special lucky number. He allows the player to 
whirl the needle on a charge of Re 1. When the needle stops at the lucky number, the gamester 


pays back the player Rs. 2 and at special lucky number, he pays to the player Rs. 5. Is the game 
fair ? (Ans. Not fair; player loses Rs. 0.37 per game] 
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28. A bag contains 2n counters, of which half are marked with old numbers and a half with even 
numbers, the sum of all the numbers being S. A man is to draw two counters. If the sum of the 
numbers drawn is odd, he is to receive that number of rupees, if even, he is to pay that number 
of rupees. Show that his expectation is S/[n(2n — 1)] rupees. 

29. A prisoner is trapped in a cell containing three doors. The first door leads to 
takes him to freedom after 2 hours travel. The second door leads to a tunnel which returns him 
to the cell after 3 hrs. travel. The third door leads to a tunnel which returns him to his cell after 
4 hrs. Assuming that the prisoner is at all times equally likely to choose any one of the doors, 
what is the expected length of time until prisoner becomes free ? 


5-43. Method of Indicators 


uM : Let X,, X,, ..., X, be independent with masses P{X; = j} = I/n, j = 1, 2, n, 
& 1, m. 


If D is the number of distinct values among Х|, X5, ..., X,, show that 


a tunnel which 


PC etu 2 2 
E(D) -si- (225) fer É when _ is small. 


Solution. Let р = Р{Х, =j}, then д = P{X,#j} = 1 - p. 

P(X, +), X» = j,.... X, + ј}=9.9-.9= (9) [X; are indep] 
So P{L,} = P(Atleast one X; 2j) = 1 - P(X; #j for all i} = 1 — (q)k 
Now define the indicator : 
T | if X, = j for some i, i.e. for at least one i 


ji ~ |O, otherwise 
Then ЕС) = F PC; = уко. PCI; + 1), for some i 
= Р(І, = 1), for at least one i 
-1-( 
By definition of D, 
De У1,,ј=12,...,п 
E(D) = YEU, = $a-s)-a-4) У1=л1-4°) 


ЖААК ве ту 
n|1- (1 »l-»| I 1) 

к КК-1 
т-а) [By Bin Thm.] 


wo bur 


5-50. Expectations for Bivariate Distrbutions 


Def. 1. Let X and Y be two variates with a given joint p.d.f. f(x, y) and let g be a real- 
valued function of two real variables, g : R^ — R. If the distribution of Z = g(X, Y) i5 


known, then we define 
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$5-51. Two Basic Properties of Expectation 


E(Z) = 2.zP(Z- z;),Z:discrete. E(Z)= |? 2f,(z) dz, Z: continuous 


This definition is, in effect, a uni-variate expectation. If f, is no longer feasible to 
investigate, we adopt : 
Def. 2. The expectation of Z = g(X, Y), where X, Y are jointly distributed with p.d.f. 
fox. у) is defined by 
22,869. yj) P(X=x,,Y=y,) [X,Y are discrete] 
Е(2)= E[e(X, Y)] = ae | 
Б у) f x, у) dx dy, [Х, Y : continuous] 
provided the double sums (or double integrals) are absolutely convergent. 
The equivalence of two definitions can be established, as in Art. 5-20 (L.U.S.) and 
shall not be repeated here. 
For the special cases, g(x, Y) = Xor, Р, yj ER їр Ү = Ур | ме obviously have 
Уух P(X =x, Y= у) XY P(X-x,Y- yj) 
B Ре Ey)! 
Г.Т. y) x dx dy FE fos у) y dx dy 


5-51. Two Basic Properties of Expectation 


1. Expectation of a Linear Combination : Linear Property 
Let g and h be real-valued functions of two real variables x and y. If a and b are any 


constant, and Z = ag(X, Y) + bh(X, Y) then 
E(Z) = E[ag (X, Y) + bh(X, Y)] = aE[g(X, Y)] + PE[A(X, Y)] [lin E] 
Proof. The result follows instantly, since by the Kernel definition of Expectation 


E(Z) =Elag (X, Y) + bh(X, Y)]= [> [7 lag (x, y) + ЬЩх, у)] f(x, y)dy dx 


= a [^ [eG Y) y) dy dee bf” f hs у) fG y) dy dx = aE[g(X, ¥)] + BELA, Y). 


Сог. 1. Let g(X, Y) = X, h(X, Y) = 1. Then : E(aX + b) = aE(X) + b. 

Cor. 2. Let g(X, Y) = X, A(X, Y) = Y, then E(aX + bY) = aE(X) + bE(EY). 

Note that this result is true whether X and Y are independent or dependent. This rule in 
Cor. 2, being very important, we give an independent proof. 

Lin E. Let X and Y be two variates, either both discrete or both absolutely continuous. 
If E(X) and E(Y) exist, then E(aX + bY + c) exists and 


E (aX + bY +c)=aE(X)+ bE(Y) +c (a, b, c constants) 


Proof. (1) Assume that both X and Y are discrete. Let {x,} and {y,} be the possible 


values of X and Y and let us use notation : 


P(X =x, = у) = PG, y) = pj; РК = х) = Р(х); P(Y = y) = Po) 


2 06 Mathematical Expectation BE 
The possible values of aX + bY + c are ax; + by; + € with probability, P(x;, уу). Observe that. 


2, PG, уу) =D Pi =P{(x,,y;) ЧУ (х), yj Ы ...} = РО) AN 


Similarly, >) Р(х, у;) = Y, pj = Р(х). (ii) 
j j 


LINEARITY OF EXPECTATION "E" 


Since | ах, + by, + cl Slallx; 1+ 15 11у е1 hence 


2 Хах, + by; + cl p; Slal Ух, 1р; +1bI Diy, lp; +1с15р, 
ij uU 


ЖЕ. 
This is equivalent to 
E(laX + bY +c)l)<lalE(X1)+IDIECY D) t+lel.l<a 
because E(I X I) < о, E(I Y < ©. Consequently E(aX + bY + c) exists. Now, 


> Y (ax, + by; + с) Dj = ау У xp; +b Уур +сУ У; р, 
ca m Dp lud 


= aX,x,[X;p;]-* bE ;y[Z; pj] + c — aX,x;PQx;) + bz jy,P(y;) + c, [by (i) and (ii)] 
RA E[(aX + bY + c)])  aE(X) + bE(Y) + с 
(П) If X and Y are both absolutely continuous, we see that 


[faceret ros duty stat” fnt fos ob" [лозата [заа 


This is equivalent to : ElaX + bY + ci&lalE(IXI) +1ЫЕ (IY D) +I cl<o. 
because E( | X | ) < o, E(! Y I) < ©. Conseqnetly, E(aX + by + с) exists. Now, 


f ac by el flay) dudy aff xdx[ у(х, y) dy уф]? fo yy dx f f ax dv 


= af” xf Q0 dx = bf yfy(y) dy * c 
E(aX + bY + c) = aE(X) + bE(Y) + c. 
2. Expectation of a Product of Independent Variates 
If g and Л are real-valued functions of x, y and if X and y are independent variates, then 
E [&(Х) МҮ)] = Elg] E[ACY)]. 
Proof. Here f(x, y) = Aœ AM) [X and Y independent variates] (i) 
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$5-60. Variance, Covariance and Correlation Coefficient 


II 


Now Ele) . A) = [^ f^ 20) лу) fx, у) dy dx [Def. of E] 


II 


EE eho). 00 (у) dy dx [by @] 


II 


f во) ло) de. f° һу) fy) dy = EtatOO] -EAYN 


Cor. Let g(X) = X and h(Y) = Y, then above result reads : E(XY) = E(X) EY). 
In view of the importance of this Cor., we append an independent proof. 
Product Rule. Let X and Y be two variates, either both discrete or both continuous. If 
E(X), E(Y) exist and if X, Y are independent, then E(XY) exists and 
E(XY) = E(X) E(Y) 

Proof. (1) Assume that both X and Y are discrete. Let {x,} and {y,} be the possible 
values of X, Y for various i, j. We denote | 
Р(Х = x) = Р(х), P(Y у) = PO); Р(Х = x, Y = y) = Р(х, ур = Рх). P(yj, [by independence] 
Now E(X) « ©, E(Y) « o; so, using independence. 

22 xy; Р(х, уу) = I.I; | PILE y; | PO, JS EI X I.ETY I<. 

P i i 


It follows that E(XY) < œ, i.e. it exists. Further, using independence. 


ХХ xy; PO y;) =P y PO > Е(ХУ) =Е(Х).Е (У) 


(П) When X and Y are both continuous, the proof is similar to (i), save that integrations 


replace summations. 
Extension. If X,, Х,, ..., X, are mutually independent variates, then 


EU, Xo, uae EG EGG E). 
The proof is immediate by the principle of Mathematical induction. 


9-92. Property. F, (t) > F, (t) for all t € R, then E(X) > E(Y) 
Proof. E(X) - EY) - E(X - Y) = |15,0) - F, 0] dt + [tL - 50)-U- EO) dr. 185-11) 


= [° 15,0) – Fy dt 20, by hypothesis 


This gives E(X) > E(Y). 
Comment. We say, X is randomly larger than Y if Fy(t)2 F(t), V t. 


5-60. Variance, Covariance and Correlation Coefficient 


Let X and Y be any two r.v.s E(X) = ру and E(Y) = py. The following quantities are useful : 


(a) The Variance of a variate X is denoted by var (X) or oy and is defined by 
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(b) The Covariance between X and Y is denoted by cov (X, Y) or Oyy al 


[ Cov (X, -EX - n). н) ЕХ) - EGO EQ) | 
(c) The Correlation Coefficient between X and Y is denoted by Corr (X, Y) or pC 


and defined by 
p(X, Y)20,,/ 040, 


Sometimes we write ry, = py, or simple r instead of p(X, y) 
Some analysis and application of these concepts are presented in section 5-70 onwards. 


5-61. Theorem 

If E(XY) = E(X) E(Y), i.e. oy, = 0, then X and Y need not be independent random variables. 
Proof. We consider a counter example, many more counter examples are possible. 
Suppose X has a symmetric density f that is, f(-x) = f(x). Let Y 21 X |. Now 


ad is defined by 


X, Y) 


E(X) = [^ xfG) dx 20; E(XY) = [^ x Axa fo) dx 20 [Odd Integrand] 


Thus, E(XY) = 0 = E(X) E(Y). But Y is related to X by Y = I X |; hence X and Y are not independent. 
Note. (i) Let X ~ unif (-1, 1); then f(x) = 1.2, -1€ x < 1. Now let Y= - 


E(X) = f х.1 dx - 0 E(XY) =Е(Х?)= |x’ dx - 0. 
Thus E(XY) = E(X) E(Y), although Y = X’, i.e. X and Y are dependent. 
(ii) Let p(-1) = +, р(0) = 1, p(D = 4; Let Y = X? 
E(X) = (-1)+0+(4) =0 = EXY) = EQ) =0 
Thus E(XY) = E(X) E(Y), although Y = Х? i.e. X and Y are dependent. 


5-62. Worked-out Problems 
Example 1. Discrete variates X, Y are so distributed that each X and Y have at most two 
mass points. Prove or disprove : “X and Y are independent iff they are uncorrelated”. 
Solution. Let X assume only two non-zero values a and b, (a = b) and Y assume only 
two non-zero values c and d, (c + d). Write A = (X =a}, C= (Y = с} and suppose I, and 
Iç are their indicators so that E(I,) = P(A) and Е(1.) = P(C). Then we can express X and 
Y as under : 

X=(a-b)l, +b, Ys (c- 01+ а [/, = 1 if Х =a, etc.] 

Cov (X, Y) = Cov [(a = Р, + b, (c - d) + d] 

= (a – b) (c – d) Cov (ly lc) 

= (a – b) (c - d) (EC Io) - EQ) E(Q) [/, lç = lic] 

= (a — b) (c - d) {P(AC) - P(A) Р(С)) 
Thus Cov (X, Y) = 0 iff P(AC) = P(A) P(C) 


Note that Ind (A, С) = Ind (A, C), Ind (A, C), Ind (A, С), etc. 


А 
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Example 2. Let X and Y be two variates having finite Meany. Prove or disprove : 
(i) E{min (X, Y)} < min [E(X), E(Y)] (ii) E[max (X, Y)] 2 max (E(X), E(Y)) 
(iii) E[min (X, Y) + max (X, Y)] = E(X) + E(Y) 
Solution. We recall the definitions : 

min (X, V) = 3[X -Y) -1X - YI]; max X, Y) e IC Y) «1 X - Y IT; A) 
ani IEX- PI < EX- Y) [By Ex. 5-2] Wes 
(i) E[min (X, №] = 5[E(X +Y) - HE( X - Y ) < E(X + Y)IE(X Р) [by 1(b) and (2)] 


ie. E(min (X, Y) S3[(E(X) + EY) -IE(X) - EY )I} = тіп [E(X), EY )] [by 1(b)] 
This (1) 15 true. 
(ti) Е[тах (X, Y)] = 3[E(X - Y) -El X -YID]2;E(X + Y)IE(X - Y)l]l. [by 1(b) and (2)] 
= j[E(Y) +1Е(Х) – E(Y)I] = max [E(X), E(Y)]. [by 1(b)] 
Thus E[max (X, Y)] max (E(X), E(Y)] is true. 
(iii) Obviously : max (X, Y) + min (X, Y) =X + Y. 
E[max (X, Y) + min (X, Y)) = EX + Y) = E(x) + E(Y). [True] 
Example 3. Prove or disprove : 


(a) E(Y) > E(X) iff Р, (7) > F(t), V t. (b) If F(t) = F(t) V t, then P(X = Y) = 1, iie. identically 
distributed variates are certainly equal. (c) If E( Y) > E(X), then F x(t) > Ft) for some t. 


Solution. EY) = P'ü-Raola-[ mold (8 5-11] 

E(Y) - E(X) = f te oOI- F,(t)] йг. [On simplification] 
Thus, Ру) > Ft) > EY) > E(X), Y г. 
Now consider some c.d.f.’s of X and Y defined as under : 


TOTA i,0xt«4 


FY) = n t2] ^o- |: t24 

Obviously, F At) > F(t), V t. The corresponding expectations аге 
EX) = [01-5014 = [tar fa-nar- 2 
EQ) = ['t- 5aoldr- (1-3) + fa- Darei. 


Thus E sys E, => F(Y) > F(X). It follows that (a) is untrue. Vide Preperty §5-52. 
(b) We define X, Y on Q = (A, t), coin-outcomes, by cross-images : 


КО  [o, 1j; P{X(h) 20) = += P(X() = 1; Y : Q9 [0,1]; PIY (h) = 1) = 3 = PIY) = 0) 
D; .oz«0 

Obvisouly, F(z) = Еу) = 1, 0<2<1 
1, ee ly 
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' = Р = 0. 
Thus, X and У are identically distributed, but р{о : X (0) = Y(@)} = Pia) = ‹ 


Note. (i) Р(Х = Ү) = P((X = 1, У= 1) 7 (Х = 0, Y: 0] = О аѕ (Х = Aia EE e 
Y = 0). (ii) Other examples are also possible. If X is NOU тепала =л are identically 


distributed, but obviously, they are unequal. 
(с) Е@)-Е(Х)= | Ue (0) - А014 = J [by (a)] 
Thus E(Y) » E(X) > J>0°> Fy )> FO), atleast for some t. 


Example 4. Prove or disprove 
(a) P(X > Y) = 1 iff E(X) » E(Y), (b) E(X) > E(Y) 2 P(X > Y) > des 


Solution. (a) Let Z = X — Y; then E(Z) = Xz f(z) = E(X) - ECD. 


By hypothesis, p(Z > 0) = 1, it follows that Z assumes only non-negative valu 


es, SO 

Yzf(z) > 0, whence E(Z) > 0 > E(X) > E(Y). Thus P(X > Y) 

Note. P(X 2 Ү = 1 => E(X) > E(Y) is true. 

Now consider the bivariate distribution as shown 
E(X) = 4p + 12р = 16р = $ 
E(Y) = 2p + 4p + бр = 12р = 2. 

Thus E(X) » E(Y). Now 

(X» Y)-(Q, 1), (3, 1), (3, 2), PX > Y) = 3p = 1. 

Thus EW >S EH SPAS Ky =f. So (a) 15 untrue. 


(b) Recall: Е(Х) = f [l - Fi G9] dx - [FQ dx 


E(x) - E(Y) > 0 = | 150) – А014 >0 => F,(t)>F,(t) [F is monotone] ...(1) 


р(Х> ү) = | PX>YIY = у) 50) ду= | PC» у) AO) dy 


In above integral, we have used F(—») = 0, Е (о) = 1, F(t) = f(t). Thus (b) holds. 
Problems with Solutions Provided at the End of the Text 


1*. Let X and Y be dependent variates. Find the minimum value of 
Н = E[Y - (а + bX’. 
2*. Show that if E(XY) = Е(Х E(Y), then X and Y need not be independent. 
3*. n identical coins are tossed. What is the expectation of the number of heads ? 
4*. А deck of cards is well-shuffled. What is the expectation of the number of cards 
on top and the first ace from the top ? 


5*. Three urns contain respectively 3 green, 2 white balls; 5 green and 6 white balls; 
4 white and 2 green balls. One ball is drawn from each urn. Find the expected 
number of white balls drawn out. 
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6*. An urn contains a white and b black balls and c balls are drawn. Find the 
mathematical expectation of the number of the white balls drawn. 


Mathematical Expectation 


4*. Die Distribuition. Two distinct integers are chosen at random and without 
replacement, from the first six positive integers. Compute the expected value of 
the absolute difference of these two numbers. 

8*. In a certain society, an individual pays income tax only if his income x is greater 
than a, the amount of tax being c(x — a) where 0 < c < 1. The distribution of the 
incomes of individuals liable to tax has density function f(x) = Ray к > а 
0» 1; f(x) = 0, otherwise. Show that the average tax paid is ca(0 — 1). 

It is proposed to increase the tax on each individual whose income x is greater 
than b(b > a) by an amount c(x — b). Show that this will increase the average tax 
paid by 20%, provided b is chosen so that (bla)? P 

9*. Find E(XY) and E(Y?/X), when variates X and Y have the joint p.d.f. 

P(X = x, Y = у) = (х + у2)/42, х= 1,4; y =-1, 0, 1, 3, ; Р(х, у) = 0, elsewhere. 

10*. For any constants a and b, show that the variates X and Y are independent iff 

E[u(a — X) u(b — Y)] = E[u(X — a)] . E[u(b — Y)] m y 
where u(z) is the unit step function defined by u(z) = 1, if z > 0; u(z) = 0, if z < 0. 

11*. Events А, A,, ..., A, are mutually independent iff their respective indicator variates 

Ji, Jz, ..., J, are independent. 


Exercise 5(b) 


1. (a) A die is thrown. Show that the expectation of the number on this die is 7/2. 
(b) Two unbiased dice are thrown. Show that the expected values of the sum and product of 
numbers of points on them are 7 and 49/4. 
(c) n unbiased dice are thrown. Show that the expected values of the sum and product of 
numbers of points on these dice are 7n/2 and (7/2). 

2. Two cards are drawn at random from 10 cards numbered | to 10. Show that the expectation of 
the sum of points on two cards is 11. 

3. Inalottery m tickets are drawn out of n tickets numbered from 1 to n. Show that the expectaiton 
of the sum of cubes of the numbers on the tickets drawn is mn(n + 1) ?/4. 


4. X and Y have the joint discrete distributions 


(i) Find p. If Z2 3 + 6X + 2Y. Show that E(Z) = 11 = E(Z) = 1471. 
(ii) Find p. Show that E(X^Y) = 39/10 and E[XA(Y + 1)] = 7/40. 
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10. 


11. 


12. 


13. 


14. 


15. 


. Balls are tkaen one by one out of an urn containing w white 


. А penny and dime are tossed and suppose X denote 


Е wee „> aggregate value is 
A bag contains a coin of value M and a number of other coins whose aggreg i e ism 
in M. Show that the value of his expectation 


A person draws coins one at a time till he gets the coi 


is M + (m/2). 
balls and b black balls until the 


first white ball is drawn. Prove that the expectation of the number of black balls preceding the 


first white ball is b/(w + 1). As 
s the number of heads turned up. Then the 


penny is tossed again. Let Y denote the number of heads up on the dime (from the first toss) 


and the penny from the second toss. 
(a) Find the joint and marginal p.d.f. of X and Y. 
(b) Find the conditional distribution of Y given X = 0, 1, 2. 


(c) Show that Corr (X, Y) = +. [Ans. 0) 22) = 2,61) = 45 g(0)=8(2)= i407 4] 


2 


- You order a wall to wall carpet m x n foot rectangular dim. The rug should be cut in one piece 


from a very wide (more than m feet) and long roll of material. It is known that the workman 
cutting the carpet never gives less than the ordered amount but usually makes a 'random 
error' in the measurement of each linear dimension, which is, on average 2% of the required 
length. Assuming the errors in measuring the length and width of a carpet to be independent, 
what is the expected area of the delivered carpet ? 


. An urn contains three balls numbered 1, 2, 3 and a sample of size two is drawn without 


replacement from it. Let X be the number on the first ball draw, Y the larger of the two numbers 
drawn and Z the smaller of the two numbers drawn. 


(a) Find the joint discrete density of (i) X and Y, (ii) Y and Z. 
(b) Show that P(X = 11 Y 2 3) = 1/4, Corr (X, У) = 43/4, Corr (Y, Z) = 1/2. 
(c) Show that the conditional distribution of Y is P(Y=21Z=1)= x EP 317-1) 
An urn contains 4 balls, two of the balls are numbered with a 1 and the other two are numbered 
with a 2. Two balls are drawn from the urn without replacement. Let X and Y denote the smaller 
and larger of the number on the drawn balls. Find the joint p.d.f. of X and Y and show that the 
marginal densities of X and Y are f(1) = 22) = 5/6, f(2) = g(1) = 1/6. Also Corr (X, Y) = 1/5. 
The joint p.d.f. is fx, у) = 24y (1-х). OS y <x < 1; fx, y) = 0, elsewhere. 
Show that EQCY) = 4/21, E(Y'X) = 1/7 and E[Y'K(1 – X)] = 6/5. 
The joint p.d.f. of X and Y is given by fix, y) = 2x(x — y), x < y < x. 
Find the marginals and show that ECX TE Dus „ыы 16-0)" 1+ р"! 

т+п+4 т+1 з ут л 3 
X and Y are jointly continuous and f(y 1x) = 1, x « y «x & 1: f(x) = 1,0« x « 1. Find PC Y« 1), 
f(x y) and show that EY) = 1, and Corr (X, Y) = 1/ 4/2. 


The joint p.d.f. of X and Y is fix, y) =х+у, 0€ x, y <1; fü, y) = 0, otherwise. Show that 
E(min(X, Y)) = 5/12 and E( max (X, Y)} = 9/12. 


Let Х|, X, ..., X, be a sequence of i.i.d. variables. Suppose X, assumes only positve integral 
values and E(X,) = p exists, | Sk <n. Let $,2 X, X, 4... + Y. 


(a) Show that E(S,/S,) = m/n, for | mn. 
(b) Show that E(S;) exists, and E(S,, /$,) =1+ (m — nuE(S;!) for 1& m «n. 
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(c) Verify and use the inequality x + x > 2, (x > 0) to show 
E(S,/S,) 2 (т/п), for m, n > 1. 

16. Show that the expected leng Nite ahaha AT | І 

нурии f gth of the chords of a circle of radius a taken at random in the 
Joints P а are selecte 
17. Two points P and Q are selected at random in a square of side (length) a. Show that 
? > 
E(PQI)2a*/3. 
. Two points P : РЕ ee i ! 

18 dii р ip (т, Ө) and Q(r,, Ө.) are selected uniformly at random in a circle of radius a and 
m^. origin. Show by brutal integration that E(I РО |) = 128a/457. Verify by Crofton 
method. 


19. The probability of a shot hitting a point distant r from the centre O of the target follows the 
p.d.f. p(r) = 2/ n(1-- r^). The target is divided into four regions as follows : 
C, : within the circle with centre О and radius 1/ J3 
C, : without C, but within the concentric circle of radius 1. 
C4, : without C, but within the concentric circle of radius 43; C, : without C,. 


The Scores for hits in the regions C,, C,, Сз, C, are 4, 3, 2, O respectively. Let X; be the number 
of hits registered іп the region C, i = 1, 2, 3, 4 when a total of N shots is fired. Find : 


(a) The probability distribution of Х|, X5, X3, X4 
(b) The probability that the score after 5 shots exceeds 15. 


(c) Expected score after 5 shots. 
EEUU US SAM, (dS asset ої positive interchangeable variates, show that 


E(S,/S,)=k/n, 1<ks<n, 5, = X, +X, * ..* X,. 

[Def. Set of variates Х|, X, ..., X, is said to be interchaneable if the joint p.d.f. of (X,. ..., X,) 
remains unaltered under any permutation of (ће X/'s. 

Note that i.i.d. variates are always interchangeable]. 


5-70. Variance : Spread of Distribution 

Let X be a random variable. Then, putting E(X) = и, the variance of X, written Var (X) 
or D. is defined by Var(X) = E(X - uy. Thus 

КИЕУ (х- D Py x), X3s discrete; Var (X) = Ѓ е — uy f(x) dx, X is continuous. 


The variance describes the spread or dispersion of the distribution about the central 
point p. It is a useful quantity in the sense that it summarizes information about the 


shape of a distribution. As Var(X) = XX - TN > 0 (necessarily non-negative), its positive 
square root is called standard deviation (S.D.), and is denoted by oy. 


Note. Some authors write V(X) for Var(X) : a bad practice. 


5-71. Some Operational Properties 

l. Var(X) = E(x’) - [EX]? (Working Formula) 
2. Var (aX + b) = а? Var (X) 

3. Var (aX + bY) = ас + су + 2ab0 yy 
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Proof. These properties are proved using definitions and lin E. Write X, = X- Uy 

(1) Var(X) = E(X- р)? sEGOC —2uX + ц) = ЕХ? 2) -24EQO + p? 
= E(X?) - 2p? + p? = E(X?) - [EQO] [р = Е(Х)] 


Y, = Y — p. 


0x 


(2) Var (aX + b) = E([aX + b) - E(aX + br = E([(aX + b) - (ap + by) 
= Efa?(X - y] - àE(X - uy! =a? Var (X) [Lin E and Def. of Var] 
Note. Var (aX) = а? Var(X); Var (b) = Var (Constant) = 0. 
(3) Var (aX + bY) = E([(aX + bY) - E(aX + bY)j) = E([(aX + bY) -ax + buy )]) 
= E{[a(X - a WY — њу) Ma? Xo + Ь?У + 2ab(Xo, Y,)]. 
= E(X?) + PE(2) + 2abE(X,Y,) = а202 + 202 + 2abo уу [Lin E & Defs. of сх and oy] 
Note. Var (aX + bX + c) = Var (AX + bY). 


Variance of an Indicator Variate 


1, if event A occurs with probability p 
0, if event A does not occur with probability q —1— р 


Here X 2 
E(X)21.p*0.q- p Е(Х?) 2l .р+ 0? .д= p.Hence 
Var(X) - EQ) - E'(X) = p- p’ = p(l- р) = рд. 
Minimal Property of Variance 
E(X - o)! = ЕХ - p) + (y - OP }=E((X -m + 2(u - e) (X — н) + (и - с)?} 
= E(X - py) + Xy - e) E(X - р) + (и – с)", [by Lin E] 


o} +20 с) (и-н) + (a - o 2 o$ * (с), [E(X р) = р-р = 0] 


Since (p — с)? > 0, hence E(X - c 202 20-592 <E(X —c)’. 
Thus, Var(X) is the smallest 2nd order moment, i.e. EX – cy is the minimum when c =н. 
Aliter. Let H(c)=E(X – c) = E(X? - 2cX + с?) = с? - 2cE(X) + E(X?) 

H'(c) = 2c - 2E(X), H'(c) 22 0. H'(c) -0 = c- E(X)- р. It follows that 

Н = E(X - с)? is minimum when c = p. 
Example : Show that if P(a € X € b) = 1, then E(X) and Var (X) exist and that a < E(X) < b 


and Var (X) < (b — a) ?/4. 
Solution. Since a € X < b, almost certainly, using f(x) as p.d.f. of X, we get 


a[ f(x) dx о) de < b[ f(x) dx = a s EQO <b. 


Thus, E(X) = p exists. Further 
a<X<b = a-i(a*b)& X-$(a* b) &b- (a b) 1X - 3(a € b)| « 1(b — a) 
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| | 2 › РР à 
Thus, E[X - (4+ D] < 1(b—a)'. By minimal property, Var (X) < E(X — c), it follows 


that [c = (а + b)], Var (X) exists and that с> <Е(Х - oy! « 1(b - а)? 
B $1 | 


5-72. Theorem. Variance of Degenerate r.v. 

(i) Let X be a discrete variate. Then Var(X) = 0, iff X is Degenerate. 

(ii) If X be a continuous variate, then Var(X) = 0. 

Proof. (i) Var(X) = 2 (x; - ш)? p, = 0, which can happen iff x, = |! for every i. Consequently, 


Var (X) = 0 iff the only possible value of X is р, in other words, iff P(X = p) = 1. 
Observe that 


Var (X) = Е(Х?) – [EGO] =c? с> 20 (if X = constant = c) 
(ii) When x is continuous with E(X) = р, then 


Var (X) = |? ро) (х р)? dx 0, ift f(x) 20 whenever x » н. 


However, this is not possible for any density function f defined on ] —%, © [. 
Remark. Var (X) = 0 < P(X = p) = 1, also follows from Chebyshev's inequality. See 
Chapter 10. 
5-73. Variance of a Linear Combination of Independent Variates 
If X,, X,, ..., X, are independent variates, then 

Var (a,X, + aX, +... + a,X,) =a, Var (Xj) +... + a, Var(X,) Жу 
Proof. Let Z = a,X,+...+.4,X,; then E(Z) = a,E(X,) +... + a,E(X,) [Lin E] 

Z -E(Z) = a[X, - E(X))] + ...* a,[X, -E(X,)] - aY, +--+ a,Y, where Y; = X, - E(X; 
1 <i € n are centred variates. Now 
Var(Z) = EZ - Е(2) = E((ZaY;) ) = E((ZaY;) (Za,Y,)} = E(ZaajYY;] = ZYaaE(YY,)..2) 
Now X, and X, are independent, hence so must be У, and Y; whence 


EW,Y,) = EY) E (Ү,)=[Е(Х,) - EXC] LEX) - EGX 9] 70,19 j- 
Using linearity of E in (2), setting E(Y, Y) =0 V ij, i 2 j, and Е(У2) = o) we get 
Var (Z) = XXaa;E(Y Y) агыр, 


Сог, Var (X) = o? / n, if X; are i.i.d. with Var (Xj) = o. 
Proo A 
f. Putting ст 2.0, =в?;а,=..=а„=1/п into (1) we ре 


Var(X)=(0° +0° +...407)/n? =07 In. [X 2 (X, +...+ Х„)/л] 
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5-74. Variance Conditioned by an Event | 
The variance of a random variable X conditioned by the occurrecen Eur event A is 
denoted by Var(X | A), and is defined by 
Var(X 1A) = E{(X - и) | A), 
This can be trivially simplified to 
Var (X | A) = E(X | A) - EX I A). 
Theorem. Let (A;) be a measurable partition of the sample space 
If Var(X) exists (i.e. ву < оо) then, with p = E(X), we have 
Var(X) = X, P(A) Var (X 1A) + ZA) (ETA; - p]? 


42 and P(A,) > 0, Vi 


Proof. Recall that 
Var(X) = E(X - p) = X, РКА) ЕХ - н) 1 AJ. 


= Df, (х? dP =F f, UX - EC AJ] - IEQCI AD p аР [adjustment] 


[Art. 5-41] 


Yl, [X - E(XI AJ P + J, [E(X 14) - uf dP| E j, IX - EX; ТААР = ) 


= E (РА) Var (ХТА) + P(A, [ECL A) - HD) 


5-75. Worked-out Problems 
Example 1. Let X and Y each take on either the value | or —1. ben tx = i, Y =j}= 
pli, j), i = +1, j = +1. Suppose that E(X) = E(Y) = 0. Show that p(1, 1) 2 p(-1, —1) and 
p(l, -1) = p(-l, 1). 
Let P = 2р(1, 1). Find Var(X), Var(Y), Cov (X, Y). 
Solution. It is convenient to write probability as a, b, 
c, d (shown herein). Now 

E(X) 20 => (a*b)-(c*d)-7 

E(Y) 20 > (a+c)-(b+d)=0. 
Since a + b + c + d = 1, these give cia 

a+b =с+а=1/2 T Bivariate Distribuition 
atc = Б+а = 2 ii) 

whence b = c, i.e. p(-1, 1) = pC, —1). 
Егота+Ь+с+а= 1,а+ Б +а+с= 1, wegeta=d, і.е. р (1, 1) = р (-1, -D 
Second Part. Given р = 2а. Now 
Var (X) = E(X) - EX) = E(X’) -0 = (D^ (a + b) + (-1) (c +d)=a+b+c+d= l. 
Var (Y) = EY?) - E(Y) = E?) – 0 = (1)? (ae с) + C! (bed) =a+b+c+d=! 
Cov (X, Y) = E(XY) - E(X) E) = Е(ХЮ) - 0 

= (1) (D) a + (1) (CD b + C1) (1) c + Cl) Cl) d = (a + d) = (b + с) 

- (a + d) - [1 - (a + d] = Xa + 4) - 1 2 4a — |. 


z2p - 1. 


Uus 
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Example 2. From a point A on the circumference of a circle of radius a, а chord AP 15 
drawn іп a random direction. Show that E(AP) = 40/7 and Var (AP) = 2a’ [1 — (8/n°)]. 
Also show that the chance IS 1/3 that the length AP will exceed the length of the side 
of an equilateral triangle inscribed in the circle. 
Solution. Let AP be inclined at angle Ө with the diameter 
AOB, then for the random direction of AP, -n/2 < 0 < л/2 
and 0 is uniformly distributed so that fO) = 1/n. 
If AP = X, then X = 2a cos Ө. So 


dO 4a x? 4a 
rent Й а= 


dO Ва? 2 , z 
E o ds cos“ 0 d0 = 2а. г 


л/2 
Е(Х) = = (2a cos 0) 
Е(Х?) = B. (4а? cos? Ө) 


Var (X) = Var(X^) = Е(Х?)-Е?(Х) = 24° – (4а/ т)? = 2a[1 - (8/ т?)]. 
Now length of the side of the equilateral triangle inscribed in a circle of radius a is 


aJ3 (Draw Fig. to check it). So 


P{X > a43) = P{cos 0 > /3/2) = P{-n/6<0<1n/6}= (^, =2 NIE 


Example 3. If Х|, X,, ..., X, are i.i.d. unif (0, В) variates, find the var Y,. 
Solution. The р... of Y, = max {X,, ..., X,), is given by 


8,0) = nf nd] ffo ax] [fay =4.0<x <B 


= ^3 
= п. 


For neatness, write y for y,, then 


| E n n- 
рее) nos 


n n n Qai це? Ea 02 
rat dy= —H. EW) = Fr bY y! day — 


И.д n a ee 
НУВ em (n+ D? (n2) 


Note. (i) Since E{(n+ DY, / n] = B, we state that (n + 1)Y,/n is an unbiased estimation of 


Parameter B. 


' р” банде pierre ee АЧ 
(ii) Var (Hy, )= 2D var = 2 Gea yt ned n(n + 2) 


Example 4. If X ~ unif (a—4b,a+4b), find Var (Y,). 


Solution. f(x) = z, F(x) =f’ lar= —— [x, = a — (b/2), x, = a + (b/2)] 


! Ў 
LOST prs £@). = Fea 


n! n-k 


e i o» VERI ж 
х (by k-Dia-b о, QT 


x ! X, = n-k 
ЕХ = 4 | x" (x = xy) (y = x)" “dx 


! 
T neran duy 151a и [x — xy = br] 


ED] утру овп - Ko D e OBR + n Ke) (r= 1) 
£ n! | b)k-D!(n-D!. , ktn-À)! 
б (е 3 "SOME crs | 
= [a — (b/ 2)] + [bk / (n + 1)] 
! 
Е(Х2,]= тет гарар: a +25 e br тй нде р 2) 
! 
5 pra cgi En- k +1) 20x BQCe In kc T) + PB(CH2, n - k+ 1)] 


х2 + 2bxyk / (п +1) + P^ k(k + 1) / (n+ 1) (л +2) 
Var (X,) = Е(Х%,) - [EXT = k(n- k + Db? / (п +2) (л + 1)?. 
Problems with Solutions Provided at the End of the Text 


1*. If the c.d.f. of a variate X is F(x) = (1 – pe^ Um «y Оў, compute Var X 
2*. The distribution of X is given by P(X = 0) = P(X = 2) = p, P(X = 1) = | ? ES dor 
0€ p €i. For what value of р, is the Var (X) maximum ? 


3*. Random Walk Problem. Starting from the origin, unit steps are taken to the right with 
v) te “i with probability (=! =p). Assuming independent movements, 
find the mean and variance of the distribution moved B OE фе?» steps. 

4*. Let X be a random variable which assumes v ER 
P(X =k) = рд‘, k = 1, 2, .... Find E(X) and ub. 1, 2, 3, ... with probability 

5*. One die is thrown until a four is obtained. Find the most probable number of 
throws and also the expectation and variance of throws. 


6*. 


7". 


8*. 


= 


A point P is taken at random in a line AB of length 2a, all positions of the point being 
equally likely. Show that the expected value of the area of the rectangle AP. PB is 
2a^/3 and that the probability of the area exceeding a^I2 is 1/ 42 . Find Var(S) also. 


The two equal sides of an isosceles triangle are of length a each, and the angle 0 


Exercise 5(c) 


between them has a p.d.f. proportional to 0(x — Ө), in the range (0, In) and zero 
otherwise. Find the mean value and variance of the area of the triangle. 


Show that the standard error of the number of successes in a large random sample, 
when probability of success differs at each draw is less than the standard error 
of number of successes of the sample (of same size) when probability of success 
remains constant. 


Exercise 5(c) 


. (a) Show that the mean and variance of the follow:ng p.m.f. are 3/2 and 3/4 respectively: 


fix)= БӨ = 1, 2,3,... 
(b) Letar.v. X assume л values x,, x», ..., x, such that a € XS b for all j. Show that Var(X) < (b — а. 


(с) Let X represent the difference between the number of heads and the number of tails when 
a fair coin is tossed 6 times. Find p.m.f. of X and show that Var (1 X |) = 159/64. 


. If f(x) = 1/n, Ox x < л, show that 


(i) E(sin X) 22/z, (ii) Var (sin X) = (x? - 8)/ 2л. 


. X and Y are independent variates with p.d.f. P(X 260 + 1) = 1/2; P(Y = Ө + 2) = 1/2 


Let Z = aX + bY with E(Z) = Ө. Find the values of a and b which minimize Var (Z) and show that 
min Var (Z) = 4/5. 


. If t is any positive real number show that the function defined by 


m= ey x 9 y 
can represent a p.d.f. of a variate X. Show that the mean and variance of the distribution are e 
and e'(e' ^ 5, 


. Show that the mean and variance of the Weibull distribution f(r) = 2at d ; ,O<t<oo аге 


(л / a)? and (1— in) respectively. 


A continuous variate X has the p.d.f. f(x) = a + bx, 0 < x < 1. If the mean of the distribution is 
1/2. find a and b and show that Var (X) = 1/12. 

Determine k so that the following curve reprsents a frequency function 

fl) = k(x- 1) (2 - x) (3-х), 1 < x «2; f(x) = 0, elsewhere. 


Find the mean and variance of X. What is the probability that a value of X taken at random 
will exceed 1.8 ? [Ans. k= 4, и = 22/15, с = 11/225, р = 0.076] 


. The c.d.f. of a variate X is given by 


F(x) = О, x «0; F(x) 2 x/8, OS x <2, Е(х.=(1/16)х2,25х<4; F(x)=1,x24. Show that 
E(X) = 31/12 and Var (X) = 167/144. 


3. 


10. 


11. 


12. 


їз. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


A random variable X has the p.d.f. 

fix) = 30x*(1—3),0 < x < 1; f(x) = 0, otherwise. 

Show that P(X > 3/4) = 1 — 4(3/4)’ and Var(X) = 5/196. 

A continuous variate has the p.d.f. (Indicator form) 

Ах) = (x/2) 10 €x < 1) + (12) КІ <x < 2) + [8 х)/2] (2 <x < 3). 

Verify that the area under the curve is unity and sketch the graph. Show t 
and variance of X is 5/12. 


hat the mean is 3/2 


A continuous variate has the p.d.f. f(x) = ka +), -a < х < a3. 


where k is a constant. Find k, p and o when a = 77. Also obtain the distribution function and 


evaluate P(X > 0). Ane ko 12 pa Olog 2, 0) = a(12 + 12 J3 – (79/12), p= 4/7] 
Two cards are selected at random with replacement from a box which contains four cards 
ds. Find the 


numbered 1, 1, 2 and 2. Let X denote the sum of the numbers shown on the two car 
distribution of X. Also find E(X) and Var(X). 

For a variate X, E(X) = 10 and Var(X) = 25. Find the positive values of a and b such that 
Y = aX — b has expectation zero and variance 1. [a = 1/5 and b= 2]. 

Show that the mean and variance of the number of successes in a series of n independent trials, 
the probability of success in the ith trial being p; 1 < i € n are Xp, and Èp;4; respectively. 

In an objective type examination, consisting of 50 questions, for each question there are four 
answers of which only one is correct. A candidata scores 1, if he picks up the correct answer, 
and —1/3, otherwise. If a candidata makes only a random choice in respect of the 50 questions, 
find his expected score and the variance of his score. [zero and 50/3] 

Let X and Y be independent random variables having variances k and 2 respectively. If the 
variance of 3X - Y is 25, show that k = 23/9. 

A horizontal line of length a units is divided into 2 parts. If the first part is of length X, find — 
E(X), Var (X) and E[X(a—x)]. [p = 47/3, o^ = 4/12 and a^/6] 

A drunk man with n keys wants to open his door and tries the keys independently and at 
random. Find the mean and variance of the number of trials required to open the door : 

(i) If unsuccessful keys аге not eliminated from further selection. [р = n, o^ = n(n — 1)] 

(ii) If they are eliminated. [[и = (n + 1/2, 0° = (п? - 19/12]. 

Achord of acircle of radius a is drawn parallel to a given St. line, all distances from the centre 
of the circle being equally likely. Show that the expected value of the length of the chord is 
na/2 and the variances of the length is a (332) - 311 2. Also, show that the chance is 1/2 
that the length of the chord will exceed the length of the side of an equilateral triangle 
inscribed in the circle. 

A large population consists of equal number of individuals of C different types. Individuals 
are drawn one at a time and put back before the next drawing. Denoting by N the smallest 
number of drawings which produce individual of each type, find E(N) and Var (N). 


5-90. Expectation of Composite Functions 
When the function Z = g(X, Y) whose expectation is sought is expressed in composite 
form, it is best to carry it alongwith its indicators to the elevation level. The following 


examples 1] 


and 


lustrate this modern way of evaluations. It is definitely more instructive 


illuminating than the classical methods of evaluations presented earlier. 
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Example 1. Let X be Expo (A) and let Y = min(X, c). Find the Var (Y). 
Solution. Here Y = min (X, c), so that Y =X if X <c, Y = cif X > c. In terms of indicators 
fed, TO. = Orch. I, = (X > c). Thus 


EY) = Е(ХІ, + с/в) = E(XIA) + E(clg) .[f(x) = Ае, x > 0] 
= [jx he dr tcl Ae dx =үе-%ч(х 37 y + cte Y 2X 07 670 
E^) -EQCT, + сь) -EQCT,) + El?) = [лег ах e (Ae dx 
Ee (x 2xX! «2X p ect - 0X» - e 02 Ao). 
ОЕ р Dees — 257] 


Example 2. Let f(x, y) = 2, on triangular region 1 € x € y < 2. 


Compute E(X), E(Y), E(Z) where y 
КЕЛ Тог X < 3/2, Z = 2XY for X > 3/2. 


Solution. Here у(х) = f(x, y)dy=22-x), 1x «2. 
Бх) [xf (x) dx = Ѓох — х?)ах = E = A 8. 


EQ - f [oft y)dyde= f 4-x)dr=4-1=3, 


E(Z) = Е(ХІ, + 2XYI5) = Е(ХІ,) + E(XY 15). 1, =x < 3/2, 1, = x > 3/2] 


[| 2x0 — 3 dx e 2f xf y. fla, у) dy dx 


2 [^ (ax =a ук+ 2[^ ха sx y dr 


2[х* - (х? / Зу]? +H? (8 = х?)]5,, = (11/12) + (49/32) = 235/96. 


Example 3. Let X and Y be independent variates with densities (х) and f,(y). Find 
E(Z) and Var (Z) when (a) Z = | X - Y |, (D) Z = min (X, Y). (с) Z= max (X, Y). 
Solution. (a) Here Z = X- Y if X > Y,» and Z= Y- Xif Y » X. 

Hence we write Z = (X – Y)I, + (Y - X)I,, where 
Eri y:x»yhL/4 = (0, »:»»x) 

MECZ) = E[(X - Y] + ELY — 01g] = J, + J, (say) ...(1) 


у J = ff, Gc») Ло) AO) dx dy 


- Голо (f^ )ах- Голо (ло) 


= [уо EGO dx - [x00 - Кау 2 
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© © e (= i 2)] oe ‚(3 ) 
Ј = Ж уђ (у) FQ) dy - хло? – F,(x)] dx, lx» іп ( 


i i ms, W 
Substituting from (2) and (3) into (1) and collecting like ter 


E(x) - E(Y) (4) 


е obtain 


E(Z) - 2[^ эў, G)F о) dx +2[` wh) КО) dy - 


- кн already. 
where E(x) = | xf, (x) dx and EY) =] уђу) dy, are supposed known already 

-%0 —o0 ; È 2 Ж E? 7 | 
Var (7) can be had through Var (X) and Var(Y) instantly. eer Var (Z) = E(Z) - E (2...5) 

EZ) = EX - Y? = EQ) + EY) - 2E) 
= [Var (X) + E2(X)] + [Var(Y) + EY] - 2EOO E(Y)  ..(6) 
From (4), (5) and (6), Var (Z) is obtained readily. 
(b) Here Z= X, if X x Y and Z= Y, if X > Y. Hence we write 
Z YI, + XI,, where I, = ((x, y) : x * у}, Tp = (05 y): х < y). 


E(Z) = E(YL) + E(XI,) = J, + Jo, say. ay 

J, = ff уло) f) dx dy =f" vf n (Голода) а= f» 00 RO) dy mio 

I= ff хло) 00 xy - f x AG (f 09 4») dx - [хлоп F, 00] 4 (3) 
Substituting from (2) and (3) into (1) we get 

EZ) = |? x Go I Б0)Ја + [^ у, 0) - ROD dy (4) 

= EX) -E()- RU F,G) dx - [^ уро) RO) dy. Ж 


Since Z = УГ, + X'I,, we get through (4) 


E(Z*)= | х0) 1 Бо) ах + [^ yf) n Еу) dy (6) 


апа Var(Z) = EZ) = E*(Z), is readily obtained through (4) and (6). 
(с) Here Z = X if X» Y and Z = Y if Y > X. Hence we Write, as in (a) and (b) Z= ХІ, + ҮІ, 
where J, = (6, y) :x » y. І = (65, y) : x € y] i 


E(Z) = E(X/,) + E(YI3) = J, + J^, say ТҮҮ) 
J, = [f хдо) f; o) аду = f^ хло) (ix 4) = ^ x f(x) F(x) dx (2) 
J= ff,» oo f,(y) ахау = Ѓуљо) (олоо dx) dy = f »^o F (y)dy NC) 


Substituting from (2) and (3) into (1) we get 


E(Z) = [ хло) Бо) dx + | уо) RQ) dy. (4) 
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Since, zZ’ = E, * РЬ, equation (4) yields 


EZ) = |х Л) RO) de [° у? AO) RO) у. NC, 


Var(Z) = E(Z^) - Е (7), is readily obtained through (4) and (5). 
Range Z is obtainable by Зс гше: Hg + 36,. 


Exercises 5(d) 
1. Let fix, у) = 1/2, on the square with vertices (0, 1), (1, 0), (2, 1) and (1, 2). Let M = max (X, Y) 
and define Z = X if M < 1, Z=2Y if M > 1. Prove that Var (Z) = 67/72. 
2. Let fix, у) =3 for 0 Sy < x, < l.LetZ- XifX 4 Y<1;Z=1 if X Y» 1. Show that E(X) = 3/4, 


E(Y) = 3/10, E(Z) = 3543 – 9)/8. 


3. Ram plans to stock л units of Daffodill Eye-liners, at a cost of c per unit, Demand D - Pois (A). 
If units remain unsold, these may be returned for r per unit. If demand exceeds z, the extra 
units can be had at a cost e per unit. Show that the expected gain, if the units are sold at a price 
p each, is 

E(X) = A(p- r) - A(e ғ) P(«Dz n) + n(e- r) «-Dzn4 1) - n(c- р). 

Let X ~ N (p, o°) and let Y= min (X, c), find Var(Y). 

. Find E(Y) and Var (Y) if Y = | X | and X has density f(x). 

_ 6. LetX ~ unif (-2, 2). Define r.v. Zby 2= XifX «l,Z- lif X21 

Find distribution of Z and its variance. 


P One cloud is enough to eclipse all the sun. 


Praise undeserved is satire in disguise. (Alex Pope) 


Moments and Quantiles 


6-10. Moments of Random Variables 


The rth order moment of a random variable X about a constant а is denoted by р, and 
is defined by 


TM E[(X - а) ]= [(x - a)' dF(x), (general) 


[Gay f(x) ах, when p.d.f. exists 


È (x; -ay px), when X is discrete. 


We recall that, E[(X — a)'] exists iff E[I(X —a)'1] exists. When a = 0, then E(X’) is 


called the rth order simple moment and in particular, E(X) = p; =p (say) is called the 
centre on (arithmetic) mean of the distribution. 


The moments about the point E(X) are called central moments and central moment of 
order r is denoted by p, and is defined by 


н, = E(X-p)' ; pn -E(X)2 щ. 
Simple moments are also termed raw moments or ordinary moments. 
6-11. Moments : Higher-order versus Lower-order 


If E(X’) exists, then E(x") necessarily exists, where 0 < k <r. 
Proof. (i) Let X be a continuous r.v. with density f(x). 


Since the rth order moment is given to exist, the integral f° x” f(x)dx converges 
absolutely, i.e. (^ 1х1" f(x) dx < оо. Now for every k=1,2,...,r—1, we have [xl* <IxV +1. 
Consequently 
[Elx f(x) dx < [lal ЛО) dx + 1« o. 
(ii) When X is a discrete variate, we observe that 
pet ege Ix eve T S I SIC, Sa АХР +1. 

By Comparison theorem for convergent series, (i) provides 

Elx f(x) « E,[Ixl' + ПЛО) i.e. Exit) «E( XI) & 1« o. [> Ax) = 1] 
Thus E(X^ certainly exists. 
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eat t > г. 
Example 1. If E(X’) exists, then E(X’) need not exis 


r+2 We 
(r- DX* 4€ .x 20,4 » 0. | 


Solution. Let Дх) = 
П z' dz L 1} = = X E: X= Az 
4 C1 di x dx Ro TO (ee В(г + z] 
ЕС) = (r* DA Toa ALLE Gea? 
Thus, E(X’) = А (finite), i.e. р, exists. 
+1 г+1 13 dx oo 
However : E(X'* )-(r* 1) X E ery? e eode 


because the later integral is divergent. Hence for the p.d.f. (1) only moments upto 


order r exist, all higher order moments do not exist. j | 
Note. Some distributions which don’t possess moment of any order are given in 
examples 5-1 and 5-2. 


6-12. Moment Problem 

A c.d.f. determines a set of moments when they exist. However, the determination of 
c.d.f. ‘F’, when all necessary moments exist is subject to varying restrictions. Some of 
the results are : 


l. Let F be a c.d.f. of a variate X, E(X) = һ' «o, V r = 1, 2, 3, ... . If the infinite series 


EyuLf/r!,r-1,2,... is obsolutely convergent for some г > 0, then F(x) is the unique 
c.d.f. possessing these moments. 
2. For a bounded variate [P (| X | « B) = 1], its c.d.f. is uniquely determined by its moments. 


3. Carleman's Criterion : Let E(X') = u! «o for r= 1, 2, 3, EN wr. 
If E[(u5 ) ""]21&r «oo, then the sequence (u/) uniquely determines the c.d.f. of X. 
4. Some sufficient conditions for a moment sequence to determine a unique c.d.f. are: 


(i) The range of the variate is finite. (ii) ш! ү 
г .MV/2n 
(111) lim sup 250% 


6-13. Worked-out Problems 


Example 1. Give an example of a distribution which is n 
its moments. 


=,r=0,1,2,...00, 0€ x «o. 


Ot uniquely determined by 


Solution. Consider (n-Normal distribution : f(x) =(x Хот y! exp [- 1 (Un 9? Eoo 


Let g(x) = [l+asin (27 (п x)] f(x) = f. (x), say. [-l<a< 1] 
hx #0) 4х = Jy у) х dx af? x sin (2л Un x) f(x) dx T 
T Ј = г x" (эг! ес! di (Ол On x) dx 
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Put Nx=Uu=ytn, then 
ЗЭ e 0c + nu 
oo 


J= |; sin (2ли) du =e" е DY sin (2my) dy. 
The last integrated is an odd function of y, hence J = 0, whence (1) provides 
L Хеба) ах „= NU f(x) d. 


Thus, i -1 <a = 1} is a collection of density functions each different from all the 
others, but all having the same moments. 


Comments. This example shows that the moments may not uniquely define a density function. 
Example 2. Let a > 0 be any constant. If a г.у. X is such that n*P(|X|>n)—30 as 
n — 9, then show that E(IXI) «o» for0<B<a. 
Solution. We use Def. of limit. For brevity, set T, = Р{ 1 ХІ> n). Since n*T, > О as n — co, 
so given € > 0, there is ny (€) = n, (say), such that 
КОСЫ nZ, Le T,«s/m, V n2n,. (I) 
Recall geometric concept : E(Y) = [, PY >t) at [$ 5-11]. For 0 < B < a, we have 
E( Xf) - [Р(Х Ss) da= В b. x^^! P(IXI» x) dx [x = 28 ; then change dummy z to x] 
Spi tax hl a mx 
No p-! oo В-а-1 5 : d 
Ом d zs NE: dx [Т < 1 in first term, T, < £/x' in 2nd term] ...(2) 
= (п)? –[В=/(0 – png ^] (finite quantity) 
Thus E( 1 XI )Ё < оо, i.e. absolute moment of order p esists. 
Problems with Solutions Provided at the End of the Text 
1*. Show that if г.у. X is bounded, it has moments of every order. 


2*. Let X Беа г.у. such that р, «o, for some k > 0. Show that lim n*P {| X1» n] = 0. 


no 


Does the converse hold ? 
Exercise 6(a) 
l. Fora random variable X with p.d.f. 
Дх) = 1x 0sx«l ЈО) = 1,1<х52; fle) = 7 @-4),2<х<% 
show that moments of all orders exist. 
2. Let X be arv. with p.d.f. : fœ) = k[l (х2 /а?)Г" exp [-А tan! (x/a)], — © < x < %. 


Show that : (2m — r — 1) M, 7 07 - D ap;-2 7 TAN И 


24 17 E ds 
3. Show that for the distribution : dF = K[1— pue deDepel masetan 


ж. 
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EN = [ra^ 10 +2 = 2р)1и, -1 


Formulate a similar result if X is a discrete variate taking the non-negative integral value, , 
а + l, ..., b (a finite). "UE T. | 
5. Prove the moment lemma _ Mh Io vi 


EXE )eo e» Wesen SRO 1,2,...] 


6. није" IX I» а&}/Р{ 1X1>k} — 0, as k — % for all а > 1. Show thay 
X posseses moment of all orders. — — po 


LT" 
"11 


fev ao. 
ME 0<А <] 


] 4 m’ 
" d^ Me) eq : 
how that th rth raw (simple) momen: 


function. 


) 1 Sk n. show 


x Let? К-а RS S А | | Binomial 


i RE GR V 
NT 
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6-21. Effect of Change of Origin and Scale on Moments 


By definition, p = E(X - u)” ; hence if we put (X ~ a)/h U. then X a+ hU. 
E(X) =a + hE(U) => p, = E((a + AU) - [a + hE(U)})" = h" ELLU - i, Y] 
Thus, the nth central moment is invariant for the change of origin. However, the nth 


. n " 
central moment of X is А" times the nth central moment of variate U 


6-22. Standardization (or Normalization) 
A r.v. Z is said to be standard (or standardized or reduced) if E(Z) = 0 and var (4) = 1. To 
standardize a non-standard variate X, we let u = E(X), o = JVar(X) and construct a variate 


X* = (X – y/o. (1) 
Obviously, E(X*) = 0, Var (X*) = 1, hence X* is a standardized variate. Eqn. (1) gives 
the method of standardizing a non-standard variate X. 
Moments of a Standardized Variate 


Let Z = [X -E(X)]/ JVar(X) = (X - р)/о 
The nth-order moment of Z is denoted by a, and is defined by 
a, = E(Z")=E[(X —p)"/o"]=E(X - р)" /o" = n,/o" 


Thus 
Some authors use the notation of alpha, beta and gamma coefficients : 


EO 2 
В, = a3, B,=a,, ТҮ =O, y2794-3, 


B, = 0342F TU: C ДАЛ Boa) = (9,3) (43) = И, 43 .p,/07*° 


= 6-23. Pearson’s Shape Coefficients 
The dimensionless coefficients В|, Ba ү, y; are called Pearson's coefficients. 
_ The graph of a distribution is said to be 
6) Platykurtic, if В, < 3. 


- (iii) Leptokurtic, if В, > 3. 

Note. Platykurtic (Broad) curves have — р, <3 

ort tails like a platypus while 

«Рок гіс (Thin) curves have long tails ~ 
like kangaroos noted for lepping. : 
eakiness, B, is called kurtosis (or | 

'akedness) of the probability distribution and can be regarded as a era a hu 
Bree of ‘peakedness’. Also, min p, = 1, this value is attained by a varia 

e | only two values with equal probabilities. 
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B, is called the coefficient of skewne 
В, 


quency cl 
d, if y, > 0, the curve IS positive], 


onstant Y, = 
Coefficient of Skewness. The c rve. It is invariant unde, 


re 
(5) and measures departure from symmetry of af 
linear transformation. If y, = 0, the curve 1s not skewe 


skewed ; and if y, <0, the curve is negatively skewed. 
ier. 
These are important dimensionless quantities ook earl 


In the normal distribution, to be considered later, В, = 
ndard ог the ш» distribution, the quantity 


briefly its excess. 


Since normal distribution is regarded as the sta 
В, —3- y,, for any distribution is called its excess of kurtosis, ОТ 
Relation between Pearson’s Moments Coefficients 
For any variate X, for which В, and f), exist, and for any k, 
B,>B,-2k+k*), B2B, Б> +! 
Proof. Let Y = X — E(X) ; and consider the non-negative quadratic form 
O(t) = EQ? + tY + kp;)? -E[Y* + UY? + (1?  2kp)Y? + К?н; + 22, KY] 20 
= гр, 2n,-[n,* (26+ 2) p2]20. (Бу Lin E] 
Since Q(t) > О, its discriminant is negative, hence 
- р, [p + (2k +k?) р21<0; ie. p, – (2/5) + (02 +24) р 20 > В, 2 B, - (2k +k). 
If k = 0, -1, we get р, 2p, ; B5 2B, +1. ...(2) 
Remarks. We could differentiate (1) to get Q'(r) = 0 giving t = —p, / pi. The result (1) is 


true for all values of г; in particular for t= —p, / u,. And with this value, (1) reduces to (2). 


kt 


General Relations. B, o Bnrm 

In particular : B,,-. >14+-B, +B, cer, s. 

6-25. Worked-out Problems 

Example : Show that, if B, exists, then 

(1) B, >В, (ii) B, 21 (iii) When is B, =12 


Solution. Let Y = X — py, then E(Y) = 0, E(Y’) = E(X — y) i 
=p. Consid AY) 
Then, Q(A) > 0 for all real values of А. Now а nsider QA) = EQ" + 


QCA) = E?" + ZAY""" + XY") -EQ") + AEM) 42 Egon, _ Ms, + 2M yan + Hom 20 
n 21 m+n 2m 7 

Since Q(A) > 0, V X є К, its discriminant is negative whence р, ji, >(н yis) 
1 2m Кәп NI men? "77 


(i) Choose m = 2, n = 1, then (1) gives pyu, >u? or (kalu?) > (p?p?) > p, 2B: 
(ii) Choose m = 2, n = 0, then (1) provid 2 1 
Prowices H4 3 u$ or (р/р) >21 > В, 21 


r 
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BE — — i 
(1) В, =1 > и, -uj20 > Е(ү? – H5)? = Магу? - 0. Thus 
Piy*=E(y*)} = 1, ie. P(Y=+o}=1. 


Let P(Y = * o) = р, P{Y = - o] - q and E(Y) = 0 ; then E(Y) = op + (—-0)q = o(p - 4). 


Now с #0 (otherwise В, is not defined), hence р = q ss p = t = 4. 


We conclude that B, = 1 iff variate X assumes only two values with equal probabilties, 
each +. 
Problems with Solutions Provided at the End of the Text 
1*. The first three moments about origin are 
Hi = (n+ 1 B = 1 (n + 1) 2n + 1), р; = 1 п(п +1). 
Determine the skewness of the data. 
2*. Let f(x) = DIT (1-- O)]! A’ exp[-Alx]; @>0, A>0; -0<x< 0%. 
‘Show that B, = Г(50) ГӨ) /[Г(30)]?. 
3*. The first three moments of a distribution about the value 2 of the variate X are 1, 
16, —40 respectively. Show that the mean is 3, o? = 15 and u, = —86. Find also the 
first three simple moments. 


4*. The first four moments of a distribution about X = 4 are 1, 4 , 10, 45 respectively. 
Show that the mean is 5, o? = 3, H, = 0 and р, = 26. Determine p, and ф,. 


6-26. Absolute Moments 
The rth order absolute moments of a r.v. X about X = a is denoted by v, and is defined by 


v, = E(IX-al')-ZE(IYl). [Y2X-a] 


Some relations : (i) V? € v, 4. У, ce dcr yer m 
Proof. Consider the non-negative quantity Q defined as under : 
Bs EDIYI" «IY P 2Ep2IYP" »221Y 1"*" ЕУР" = A ElY ^ + 24 Ely "+" e EL ҮР” 


le. О = Xv, +2 man + Von 20 x El) 
Since Q > 0, its discriminant is non-positive — (Vm4n)? € Vam Van 

(i) Choose 2m = r 1, 2n = r+ 1 ; the result (1) follows, viz v? «v, i.v," ...(2) 
(ii) Replace r by k in (2), and raise it to power k to get v? < (v, )* (v,,)*. We rewrite it as 


Cat cO yay)” 533) 
Put k = 1, 2, 3, .... r — 1, r in (3) ; then multiply these inequalities to obtain 


| r-l r 2 r-l Р 
vi) (v. mye ^ yu ec 2) quee {= 
Yo) (vy) ЧУ; Ly ы dE Vea 4 


r-l 
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Using v, = 1, this can be simplified to 


1 г 
- Me» (ж еа (У, +1) 
Vi У, У, Aj r pe У; V5 v 23 Ld" 


^ 


r Vr < V puo 
or EA y" « EARS. > (v,) «( ip 


Note. Replacing a by py and disregarding modulus sign, Eq. (1) 
This then solves the problem : В, 2 p, and B, 21, etc. 


6-30. Factorial Moments 
The descending factorial power with span-unit Л is defined by 


x? = x(x-h)(x-2h)...[x - c- D А] 
The rth order descending factorial moment about the point X = a is defined by 


ш = EK(X-a)?]2 EfG)(x-a)". [Sum over x] 


Since (a+b) = [nae mae [Factorial Bin. Expansion] 


(X-a)" = (Xx-b«cjf? =E("\(X-B!" Px, (с=Ь- а). 
Taking expectation of both sides,we obtain 
Ha) = E c mer osrER [u^ SEX - 50] 
Often this result is written symbolically as 
Ha) = ("+ с)“. 
Remarks. In practice, we take the span-unit h = 1. 
Some Relations between Simple and Factorial Moments 
By direct expansion of (2) in §6-30, using h = 1, a = 0, we get 
Ho = Е(Х) = ш. 
W = ELX(X-DJ=E(X*)- EQ) = p; - pi. 
uy = E(X(X -1)(X -D]=E(X° -3X* +2Х) = р, —3ц + 2и. 
pa, = ECX(X-)X-2)X- 3))=E(X* - 6X? HUX? — 6X) = ш, — би, + 11и; – 612: 
Converse relations 
p, = Е(Х?)=Е(Х® + Х) = n + uin 
py = E(X*)= E(X® +3X™ +X) = ut + 386) + Hip 
pi, = E(X*) SEX? «6x? «7x? + X)e ut, + A 


+ 7h + uu. 


5 
gives Him+n) = Мә» Has. 
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6-31. Central Factorial Moments in terms of Central Moments 


For brevity let Y = X — E(X) and note that E(Y) = 0. 

[К = ED ^] - ElY(' - D) -EQ) - EY) no 71 

Ha) E[Y?]  E[Y(Y – 1) (Y - 2]  E(Y? - ЗУ? + 2Y) =E(Y*)-3E(Y?) => Ha =H- 3H 

Bay = EI^] - El? -DO -2)(Y - 3] -ElY* -6Y° + 11? -6Y] -E(Y*) - 6E?) + 1 E) 
Ha) = H4 – быз + llys. 


1 


\\ 


6-32. Reverse or Increasing Factorial Moments 
Write : X = X(X+1)(X+2)...(X+k-1)=k!(*) — Pichhommer symbols (notation) 
Define : uj, =Е[Х'!]=Е[Х(Х +1)... (X + - 1)] 


This is kth order simple reverse factorial moment; at times, it will prove more useful 
than и. 


Exercise 6(b) 


1. Show that first n simple moments determine the first central moments and conversely. 


[u, = E(X - i" р 3) x* e D ("7 R w, pr^ 


n n 

и, EKX - 1) + n" -E| 2. p ho (s p|- X Hm TERN 

k=0 k=0 

2. The first three moments of a distribution about the value 3 of the variate X are 2, 10, — 30 
respectively. Show that the first three moments about X = 0 are 3, 31, 141. Find also pi, py. 

3. The first four moments of a distribution about the value 5 of the variable X are 2, 20, 40, 50. 

Obtain, as far as possible, the various characteristics of the distribution on the basis of given 

information. [Ans. u 7, u, = 16, = —64, ш = 162, B, = 1, В, = 0.63] 

4. The first four moments of a distribution about the value 4 of the variable X are –1.5, 17, -30 

and 108. Calculate the simple and central moments and state whether the distribution is 


leptokurtic or playtycurtic. Can you find moments about X = 2? 
[Ans. p, = 14.75 ; ну = 39.75, p4 = 142.3] 


e X has mean 10, variance 16, y, = 1 and B, = 4. Obtain the first four 
[Ans. 10, 116, 1544, 23184] 

tribution based on 100 observations, the following 

n 0.7, p, = 4. 

d as 21. Obtain the correct value of 


5. The distribution of variat 


simple moments. 
6. Incalculating the moments of a frequency dis 
results were obtained : Mean = 9, Variance = 19, p, 
But later on, it was found that one observation 12 was rea 
the first four central moments. 
For a distribution of 250 heights, cal 
inches, 3 inches, 0 and 3 inches respectively. It was h 


two items 64 and 50 in the original data were wrong г, 
and 52 inches respectively. Calculate the correct frequency cons ants. 
(Ans. p= 54, 0° = 8.81, Hs = 247.3, p, = 218.424, B, = 0.004, By = 2.815] 


culations showed that the mean, S.D., p, and B, were 54 
owever, discovered on checking that the 
ly written in place of correct values 62 


m 
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stands for the absolute moment of a distribution. 


8. If mand n are positive integers, т < л and if v, 


T 
show that AM in ес Ж 


9. The variance of symmetrical distribution is 2 
distribution be | 
(a) Leptokurtic, (b) Mesokurtic, (c) Platykurüc 


6-40. Mode or Modal Value of a Distribution um. 

Let X be a random variable whose density is f(x). The mode of the E noon E tr 
model value of X) is the variate-value which corresponds to the maximum frequency 
(probability). [Differential Calculus rules] 

If X is continuous, the mode is determined by xp, x,. . 
Xo: Xp ~. Satisfy f"(x) « 0, k = 0, 1, 2, ... ; 
If X is discrete, we examine that value of variate which provides maximum probability. 


5. What must be the value of p, in order that the 


[Ans. р, >, =, < 1875] 


.. where f'(x) = 0, whose solutions 


6-41. Median of a Distribution (Med. X) 
1 


Let a varite X have a c.d.f. F(x). The real number m which satisfies F(m) 2 5 and F(m-) 


< + is called a median for the distribution of X. Combining these inequalities, median 


is given by 
p, = P= E 


Obviously, if F is continuous, р, = 0, and median is simply determined by F(m) = +. 


2 
Since there may be many values that satisfy (1), a median is not necessarily unique. 
Again since (1) always possesses a solution, median always exists. 


If F is symmetric c.d.f., the centre of symmetry is clearly the median of the distribution. 
Comments. Let X be a discrete variate with d.f. ‘F’. If F(x) = 1, for all admissible 
values of X, then the /east permissible value m of X such that F(m) > 1 is taken for 
median. However, if F(x,) = 1, then the med X is defined to be +(x, +.x,,,), where x, 
is the least admissible value of X greater than x,. 

Note. In cases where the mean of the distribution does not exist, the importance of 
median as a centring constant is supreme. (Vide Cauchy distribution). 

Example : Let f(x) = cx, c > 0, O<x<J2/c; fix) = 0, elsewhere. If the mode of this 
distribution is at x = 42/4, find the median of this distribution. 

Solution. The modal value corresponds to the point where f(x) is maximum. The st. 
line y = cx, is naturally at the greatest height at x = J/27c. Thus by hypothesis. 
J2/c = 42/4 which yields c = 16. Let m = Med X. Then by definition : 


= P(X <m)= [16x dx = 8m’ => m= or m=+4,(x #0). 


Д. 
2 16 
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6-42. Mean (absolute) Deviation (M.a.D.) 


The mean absolute deviation about a point X = a may be denoted by (a), and is defined by 
ӧ(а) = E(IX – al). 
We are generally interested іп б(н); or in ó(m), where m is median. [Notation is non-standard] 
Theorem S.D. + M.D. 
For any distribution, the S.D. c (say) is not less than mean deviation (M.D.) from the mean. 
Proof. Let и = E(X), and = E | X- wl, then for any г € R, 
E[IX- pul r2 0 E(X- р) «2EIX- pl. r4 220 => o^ + 2MtE 22 0. 
For the non-negative quadratic form in ż, the discriminant is negative. Hence 
М? «colis сж M. 
Note. This result trivially follows from Cauchy-Schwartz Inequality. [$10-14] 


6-43. Minimal Property of the Median 

The sum of the absolute deviations from the median is a minimum. 

Proof. Let m = med X. Then we are required to show that E(IX-—al) is minimized 
when a = m. That is E( 1X - ml) xE(1 X-al), or Eu X-al-1X-ml) 20 for any a. 
In the following, the nature of X is immaterial (discrete or continuous). Firstly, we 
suppose that a > m and let d = a – т (> 0). Define: А=1Х-а1-1Х – ml, and observe that : 
-d«Azd,Xzm,|Fig. (а); -d < A < d, m < X < a. [Fig. (D] ; -d < A = -d, X 2 a [Fig. (c)] 


m-x a-m x-m a-x x-a 
ILL. ENESENN Loe бак се [едтк к ш кисы ы J PROS Seek bun]. | 


X M A М X A М A X 
I«——————— ax — 
(a) (b) (c) 
We observe another random variable W which is related to the three possibilities above. 
It is given by 
W = а, for X<m; W=-d, for X >m 
and summarizes the three situations above as A 2 W, whence E(A) > E(W). Now 


E(W) = P(X € m).d + P(X » m).(-d) = [Р(Х < m) - P(X > m)]d = [2F(m) - 14 
Since P(X > т) = 1 — F(m). As т = тех Х, Ет) > 2 and hence E(W) 20 => E(A) 2 01.е. 
E(IX – al) zZE(IX — ml). Thus, E(IX - al £E(IX — ml), fora» m. 

Similarly, E(IX — al) £ E(IX — ml), fora» т. 


It follows that, E(I X —al) is minimized only 


4 и 
|. Another proof. Let X be a continuous г.у. WI 
and b = + оо is also permissible. Let 


; if a= m = med X. 


th density f(x), a < X € b; where a = —9 


H = E(X-m)- f? 1X - ml f(x) ах = j” (n х) dF) +f” (х= т) dF(x). 
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A Maa ‘hat. diftat s: NN T S) is valid, we ge 
Assuming that differentiation under integral sign (DUIS) 


; , '"^ f is the депи 
OH m ii : QH P ф (т) = 2f (m) > 0 [ Vg 15 t 1 yl 
[ f(x) dx - f. f(x) dx, p f(m) +f 


Om 


СН = 0 = |" fdf f(x)dr= > => m= med OO 


дт 
Since (д°Н/дт?)у > 0,at x = m (vacuously 


Remark. If we make an appeal to Riemann-Stieljes integral, EUN wedcticall 
combines the cases when X is discrete or continuous. The above pr p ally 


remains unaltered. (See also Ex. 6-11, p.251). 


1), it follows that Н is minimized at x = med (X) 
a unified approach 


6-50. Symmetric Density Function and its Applications 

A function f is symmetric about x = a, if fla + x) = Да — х). А random variable X is 
symmetric about X = a, if its density is symmetric about X = a. 

Theorem : E(X) = Med (X), if X is Symmetric 

If a variate X has symmetric density and if E(X) exists, then Mean (X) = Median (X). 
Proof. Here fla+x) = Ќа – х),  [Def. of symmetric density] EX 


E(X- а) = [6-2 fo) dx- | zflat 2dz- f". zf(a-z)dz [== (x — a) and (1)] 


f,a-0f04--f t-a) fdt [t=a-z] 

-E(X ~ а) [Def. of E] 

Thus 2 E(X - а) =0 = E(X) =a. [The point of symmetry is the mean value] 
We now attend to the median. So using fia + y) = fla — y), we have 


P(X > a) = JP f(x) dx- Jj flat y)dy= |? fa- y)dy - |“. f(z) dz - P(X <a) 

[x =a + y anda - у = z]. Now Р(Х > a) = Р(Х < а) = med Х = а. 
Odd-ordered Central Moments of а Symmetric Distribution 
If a Dist. is symmetric about p, then all its existing central moments of odd order are zero. 
Proof. Let f be the p.d.f. of X. By definition of symmetry : f(u — x) = fu Tx) oO 


Maui m f, fo у aye (eh hu i ay 


[х-н 7 1] 
= [шуа fr nung, [by (1)] 
T. -L ptt Р + ode | Аар, [t = — т] 


We change the dummy т to dummy г, this results in TN = 0 
He] x 
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6-51. Worked-out Problems 


Example 1. Show that the mean deviation about the median is the minimum. 
Solution. Assume that X is continuous and that med X = m. If c is any other values, we 
want to prove that 


E(X-ml)sE(X-cl), ie. HsE(X-cl-E(IX —ml)2 0. (1) 
Firstly, let us assume that c > т. Now 
E ^ [x -cl-Ix — ml f(x) dx = |6 g(x) f(x) dx.[g(x) 21x —cl - 1 x — ml] 
= (E. +], + JE aF). 
Now g(x) = (c х) -(mn— x) c—- m, when —=<х<т<с. 
g(x) = (c — x) - (x 2^ m) = (c - m) - 2x, when m « x « c. [x «c > c- m-2x » (m —c)] 
g(x) = (x —c) —(x — m) = m — c, when nmb«c-«x «oo, 
Н = |", (c—m)dF(x)+ |» (с + m -2x) dF(x)+ |" (m с) dFG) 
> [^ (c- m)dF(x) + (т-с) dF(x) + [ (т-с) dF(x)=(c-m){", dF —- (c - m) f dF(x) 
= (c— т) [Р(Х< m) - P(X > m)] = (c - m) [2F(m) – 1] 5 0. [F(m) > ias m= Med X] 
From Н > 0, assertion (1) follows. The proof for m > c is exactly similar. 
Since c is arbitrary, it follows that E( | X — m I ) is the minimum. 
Furthermore, E( | X - ml ) = E(1IX- cl) iff H 20, i.e. iff m c. 
Remark. 'The above proof avoids differentiation under integral sign (DUIS). 
Example 2. Show that p,, , , = 0 does not necessarily imply that the probability 


distribution is symmetric. Does this result hold for 2-point distribution ? 


Solution. (i) Consider three-point distribution : f(1) = 2,1-4) = 1, А5) = L. 


——— — = 3 = 1 —-——- — = 
Е(Х) = 5-3+% 0, E(X)- a tS 
Thus, иу = E(X^) = 0, but f has no symmetry about и = 0. 
(ii) Assume that и, = 0 and consider 2-pt distribution f(a) = p, fb) = q, (p + q = 1) 
Неге u = ap + bq. Since a - p = (a - Б)д, b - р = (b — a) p, 
^02 p, -E(X - n)! - (a- W° p+ (b- Ш)? = (a— Б)? pq? + (b-ay qp? = (a- b pq(q^ — р?) 
= (a - b) pq (q - p). 
Since a z b, this gives q-p=0> p=q= ne This shows that X is symmetric. 


Problems with Solutions Provided at the End of the Text 


l*. Find the M.D. from the mean and S.D. of the series ; a, a + d, a + 2d, ..., a + 2nd, 
and verify that the latter is greater than the former. 

2*. Show that M, the M.a.D. about mean m of the variate X, the frequency of whose 

ith element х, is f, is given by 


M = E M LL- Уу х. |= х7] 


N x; <m x; <m 
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) for the variate X defined by 


" : - dian 
3*. Find the trimean (mean, mode and me 


f(x) = (1), x=1,2,3,... (positive integers). 


> 
<= 


6-60. Means and Partition Values 
Let f be the p.d.f. of a given variate X. The followin 
1. Arithmetic mean. It is denoted by p, and is defined by 


u = BOQ STA yt) dx. [EQ X1) « ©] 
2. Geometric mean. It is denoted by G, and is defined by 
т G = E[(in X)]» |? (in x) f(x) ах. [ElUn (X)! < ој] 


3. Harmonic mean. It is denoted by H, and is defined by 

YG (5 ЕА -l 
4. Quartiles. Suppose the range of the variate X is [a, b]. The value of the variate X 
written Q, is called the rth quartile if 


g definitions are often needed 


P{X<Q} = f? f(x) dx» 2, r -1,2,3. 
Q, and Q, are respectively called the first (lower) and the third (upper) quartiles. The 
quantity Q, — Q, is called the Quartile deviation or Quartile range. О, is the median 
(middle quartile). 
5. Deciles. Suppose the range of the variate X is [a, b]. The value of the variate X, 
written D,, is called the rth decile if 


P(XxD,) = [= үс, DONE £9 


6. Quantiles of order p. The number x satisfying the double inequality 
para) spen, (0 « p « 1). 

is called the quantile of order p and may be 

denoted by X, OF О. If [p, = P(X = x)] p, =0, 


e.g. when X is of continuous type, then 
quantile of order p is a solution of F(x) = p. ока 
If F is strictly increasing, this Eq. has a x 


: 0 
unique solution. Otherwise, there may be Ф 
many solutions of the above Eq. and each one is called quartile of order p 


f(x) 


x тк ЖЫ ч i i 
Note. p = 3,4:%+79»» provide the values of median, lower quartile upper quartile, 
first decile etc. 


7. Coefficient of variation (C.V.). The relative variance is 621.2 i T 
S are 
root (б/н) is called coefficient of variation. RMOgovttve squ 


ee a S—SO— $6-61. Worked-out Problems Ж, З 9 
6-61. Worked-out Problems E 


Е 1. Show that in a discrete dicstrihutian ic 
e. hide M E Mei distribution if the deviations are small compared 
я" i (x/M)" and higher powers of (x/M) may be neglected, then 


(0 С=М0-(с /2М°)], (b M'-Gi-g, (с) н-м (9? M^y 
(d H.M=G’, (e) M-2G+H=0, (f) CV.=[2(M-G)/ My”. 


wm Here x c X — M is the deviation (from Mean) and (X - M/M is small, E(x) = 


| Var (х) = Var (X - M) = Var (X) = o? = E(x”). же) 
We write, X = (X-M)+M=x+M=M[1+(x/M)] „9 


(а) nG = Е (0n X) =Е( M[1 + х/ М) - E(Un M +0n(1 + x/ M) 
= On M + E[(x/M) - (х? 12M?) + ...]=(nM - (6? /24?) [by lin E and using (1)] 
И n(G/M) = —(в?/2М?у > G/M =e" 2 


or G = M[{1-(07/2M?’)). [by exponential series] TA) 
(b) Squaring both sides of (2), neglecting o*/M*, we get 
G = M'(1-c?/M?))- M? -c? > M? -G* =o NO 
(© (I/H) = E1/ ) ЕМ [12-(x/M)] !) M ' EI -x/M +x? /M?° -..) (Бу (i)] 
S Ma о/м), [by (1)] 
uh Н = M[1+(o7/M’)]' = MII - (о? / М?)]. (4) 


(i ) Eliminating с? between (3) and (4), we get MH = e. 

(e) Using the values of С and H from (2) and (4) we get 

| M-2G+H = M-2M[Il-(07/2M’)]+ МІ - (G^/M?)]- 0. 
(f) By definition C.V. = o/M. Now from (2) 


С = М-(02/2М) => c! =2M(M-G) 
С.У. = МСМ -G)/ М =[2(M - G)! мү". 


їхатр1е 2. In a continuous distribution with f(x) = yox (2), 052752 
H, G, median, M.D. and mode. Show also that Hon +1 = 0. 
ed by normality. Now 


r+3 


К 270 mean variance, В, 
olution. The constant y, сап be determin 

2 r+] NUM T orien: 
EX) = Yof,x  Q- 94791205 


a Yo put r = 0 so that 1 = 8y/6 > Yor 4. Thus 


yt = Е(х')=2':6/@+2)( +3), paras. 


Ay 
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2 NEGO Ev ets) т (5). 
In particular, E(X) = 1, E(X?) = £, so that Var (X) = E(X) ( 


1 2] 1 2 e M 
2 M i cupere, [t = x – | 
Now H5,,; = EX - y = | (x — 1) ! «(2 x) dx yo f! ( | 


ү * 2л 2 
un = Е(Х-1)* =» f G-D^xQ- х) dc» "01-104 
3 l 2n n+2 гч 3 
-5h €" onam ant 
4 = 
This verifies p, = Var (X) = +. Also py = 2, ѕо В, = u/o = B. 
From (1) Н == => Н = 
mG = уо fo (2x - x?) хах 
à 2 
4 x? 2 x? * 4, 2:10 
teo « (2 -Jes (4a feet 
Thus С = 2 exp (-2). 


Let т = med Х, then Бу its definition 
3 


MEC. жм tus ^. n M Je PX "uM Dar 
274] Qx-x)d: > q-m' -Z => m -3m +2=(т– 1) (т? -2m -2)-0. 
The value m = 1 є ] 0, 2 [, hence med X = 1. 

M.D. = E(IX - 1I) = y fo lx- 10x (2- x) dx = y, |, Ind-re)ar- 5 f (-P)dr- 5. 


Mode. Differentiating f(x) = yy (2x — x?) we get f'(x) = yo (2- 2x), f"(x) = – 2y, 

h РО) = 0 > x-1e ]0,2[, and f"(1) <0. Hence Mode X = 1. 
Since E(X) = Med (X) = Mode (X) = 1, the distribution is symmetric about X = 1. This 
is evident from p,, , | = 0 as well, that yields В, = u? /p3 =0. Further 


(UH) = EX7)-3 => H=2 [by (1)] 
Example 3. For the triangular (or Simpson) distribution with p.d.f. 
fix) = 2®+ x)/b(b+a), -bxXx«0; у(х) = (а х)Ја(а+Ь), O<x<a. 


find tri-mean and variance. Show further that if terms of order UPS" are ne glected, 
then 


Mean - Median = 1 (Mean — Mode). 


Solution. Curve y = f(x) meets y-axis at the point C(O, 2/(a + by) and area AOBC = 
bl(a + b); area AOAC = a/(a + b). Clearly under y "uU ob < x <a Area is unity. а 
expected. Further, mode being the value of X for which f(x) is maximum, is given by 
x = 0. (Fig. p.) Now, i 
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2(b ЕЕ х) E a 2(a Es. x) x" 
h, Eu o 1, "ug ^ 


E(x") = 


5 TAA e » = à 2 Өй vo x'*?| 2[a*' + (-1 p 
b(a-b)| r+1 r+2 BD. ПОЮ) ot 1 or F2 y +l) +2) (а + b) 
2 2 2 9 ? 
Thus, E(X) = 2(a" — b'y6(a + b) = (а — БЗ. EQ) = (a° + b*)/12(a + b) = (a — ab + b уб 
2 ^ 3 ; 
Var (X) = (1) (а = ab + b^ - (1) (a° — 2ab + b°) = ($) (а + ab + b^). 


Let m be the median and suppose that a > b, so that m > 0, (0 « m « a) and hence 


DEL is eee ПТ. 
2 = {азн are * T 
_ This gives, a- m = + [1 a(a + b)]"? or m-a*[La(a-*b)l". 
m 
Since m < a, we reject positive radical and so m = a- [La + (a * Б)]"?. ia (1) 


Second Part. If h = (a — b)/a, then А2 is negligible. Now using b = a(1 — h) 
Mean – Median = i(a-b)- a* [ţa + (a + D)]^ -lah-aca(|l-ih)" -ah/l2 ...(2) 
Т 1 (Mean – Мое) = ill(a-5b)-0]-ah/12 NY 


| From (2) and (3), the result follows. 
Note. We can also determine m (median) geometrically from AOAC and AMAL. 


h am 1 1 3 
m o - ——.nBeaz-di(r—-nm)/h, hence m as in (I). 
2/ (a+b) in * 


Problems with Solutions Provided at the End of the Text 
= mode X, M, = med X]. 


l*. Let X be a continuous г.у. with unimodal distribution. [Mo = mod iff н = (М, + M,)/2 
=T, 1 H= ot e^t 


Let x! = E(X - My). v, = EX - M... (M, + М). Show that т, 
* Show that the geometric mean G, of the distribution 
dF = 6(2 — х) (x- 1) dx, locas? 


is given by 60n(16 GC) = 19. 
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3*. The mean and S.D. of a variate X are т and с respectively. If the deviations are 
small compared with the value of the mean so that (X/m) and higher powers of 
(X/m) are neglected, show that 

" с? TM “| М a 
mean (VX) = i 2]. mean 7. m om 

4*. A variate X has p.d.f. : f(x) = C/(1 + x’), — 0 < x < оо. | 
Determine C, the distribution function and evaluate P(X = 0). Find also mode, the 
mean, variance and quartile range for X. 


5*. A frequency distribution is defined by 

(i) fo) =x°,0<x<1; Дх) =3(2- x), 1 <x <2. 

(ii) Дх) 23x,0 x «1, Дх) = (2-х), 1<х5<2. 

Find the mean, the S.D. and the M.D. about the mean. 
6*. Let fix) =ах?, 0 <х<1; Дх) =a(2-x), 1<x<2. 

Determine initial and central moments, skewness and excess of r.v. X. 
7*. The p.d.f. of (shifted) exponential distribution is 


Дх) = ye "^79. а<х<. (a,b, y, are constants). 
Show that y, = b = l/o and a = m - с, where m and o are respectively the mean 
and S.D. of the distribution. Show also that p, 24 and f, - 9. 
8*. In a continuous distribution with f(x) = y, (x — x’), 0 € x € 1, find S.D., С, Н, Q, 
M.D. and Modal value. Is the distribution symmetrical ? 
9*, For the distribution : dF(x) = хе" 2° х/а?, б< X € oo, 


show that [(Q, — Q,)/o] is independent of the parameter a. 
10*. A continuous distribution over range ] —3, 3 [ has p.d.f. 


Дх) = а(3+ х), -35х5-1; f(x)=a(6- 2x"), -1x x1; f(x) =а(3- x, 1<х<3 


Find the constant a and show that all odd-order simple moments vanish. Find 
also the variance and the M.D. about mean. 


11*. Let F(x) = 1 ~ (clx), ifx>c, F(x) =0,ifx<c [Pareto distribution]. 


Find trimean and Variance of X. Evaluate quantile of order p = 0.75 when a = 3 and 
с = 100. 


Ехетсіѕе 6(с) 
1. Find the mean, variance and quartiles for the distributions : 
(а) dF(x) = 2х dx, OS x&l. (b) dF(x)  isinxdx, O<x<n. 
(c) dF(x) = ѕіп х ах, OS x&mn/2. 


[Апв. 1,1,1, [2 (b) n/2, (n^ /2) - 2; n/3, 27/3 (c) 1, n — 3, cos'(3), cos (4)] 
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2. Find the first four central moments for the distributions 


(a) dF(x) = (Та) dx, —asxsa. 
(b) dF(x) = ах, О<х<1. 
(c) dF(x) = се dx, O0<x<o, 
(d) dF(x) = [2a/n (а? + х?)] dx -а<х<а 
(е) dF(x) = (x! sinx)dx, O<x<n. 
a Osx 
(f) silage et 


[Ans. (а) = p =0=p,,p,=47/3,p,=a/5. (Б) 1/2, 1/12, 0, 1/80. 
(с) co, с2, 263, 964, (d) 0, a(4-n)/n, 0, a” (Зп - 8)/3n. 
(e) 41 !,2- 161 ?,-6n 4 721 -128 л (f) 1, 1/6,0, 1/15] 
3. A variate X has the p.d.f. f(x) = k sin (13/5), 0 < x € 5 ; f(x) = 0 elsewhere. 
Determine the value of k and show that Med X = 5/2 the quartiles are 5/3 and 10/3 and 
Var (X) = 25(v' - 8)/47. 
4. Find the Pearson's coefficients B, and f), and the harmonic mean for the distributions : 
(a) dF(x) = kx! e" dx, 0<х<%. 
(b) dF(x) = kx e" dx, 0«x«o. 
(c) dF(x) = kx e" dx, x20, X» 0. [Ans. (a) 1,4.5,3 (b) 4/3, 5,2. (c) 2,6,27'] 
For the p.d.f. fx) = 1 -1 1 - xl, O€ x < 2, find p}. 
Hint. fx) = х,0<х<1; 6х) =2-х, 1 5052, 
For the triangular (or Simpson’s) density law f(x) = yo (1 - a Ix-bl),Ix-bl«a,show that 
yo = l/a, p = b and o? =a’/6, Graph the curve for a — b = 1. 
For the distribution f(x) = 6x (1 х), 0 € x < 1, prove that 
P(u — 26 < X <p +20} = 4445/25, P(X «1/211/3« X «2/3] 21/2. 
Find a number b such that P(X < b) = 2P(X > b). 
8. Let f(x) = 4x°, 0 € x € 1 and f(x) = 0, elsewhere. 


Show that the number a such that the probability that X is equally likely to be greater than or 
less than a is (12)'^. Show also the number b such that the probability that X will exceed b 


is equal to 0.05 is (0.95)'^. 
Pareto distribution with parameters r and a is given by the p.d.f. 
fix) = ral **, xza;fo)z0,x«a, x»0. 
Show that it has a finite nth moment iff n < г. Show that the variance of the distribution is 
[ra?(r - 1? . (r-2)), r> 2. 
Calculate the S.D. and M.D. from the mean if the p.d.f. is 
Дх) =(3 + 2х)/18, 2<х<4; Дх) = 0 elsewhere. 
ll. A variate X has the density : f(x) = kx/(1 + x)’, x20. 
J2 +1. Determine the sign of skewness. 


a 


е 


e 


е 


10 


LJ 


[Апѕ. с = 0.57, М = 0.49] 


Prove that k = 2, mode = 1/2, median = 
_ 12. Verify for the distribution f(x) = xe", (0 € x < o), that 
т Mean — Mode = 3 (Mean ~ Median). [Use : Ro 


С 


ot of 2(1 + x) = e' isx= 1.7] 


A continuous variate X has the c.d.f. 


F(x) «0, if x «1; Foe ka 1)“, if 13x53; FQ) 21, ifx» 3. 
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14. 


16. 


17. 


18. 


19. 


20. 


21. 


fx) = О1(х < 1) + &(х+1)/(—1<х<3)+4Ё1(3<х<4)+ 


3/4 
an = 13/5 and med X= | A0) - 
a frequency function : 
01 (x » 0). 


stribution is the least is 


Determine k and the p.d.f. Show that the me 
Determine k so that the following curve represents 


Show that the value of X about which the mean deviation of this di 


(2/ 43 = fh, 
nce find the median of the 


. For the density f(x) = 1/(1 + х), 0 < x < œ, obtain c.d.f. and he n 
m m= lp о] 


distribution. Also investigate if the mean exists. — [Ans. Fs 
A variate X has the c.d.f. : F(x) = k(ax’ - bx"), OS x51, а> р> 1. 


the median of the distribution, 
а= 1) (b - 1)/ab] 


dee: k, HL. и, c? and Н. If a = 2b, prove that m, is given by 
4 -1/2 
ale Maer | [Ans. k= (a — 6) |, p',=abl(a + ғ) (ber, H=( 


The equation of a frequency curve is y= yp (1+ 1 аг)! la:QU4) 1 (2/u)s t < oo. 


Find the constant y, and the first four central moments. 
[Ans. Hi = 0, ja L из = 4, H4 = 3+ (За? 12) 
(Hint. Put (2/a) = b, use x + b = z to obtain 


р> 2 
уо (е)! E E gir nl Бе Уо (е)? T(r + Б) 


E(X « by = +6) feo ах 05 j = 
(bf с! *o (by (by -! 
Nowr=0 > M s AB йыш, EQ «by СЕР) 
T(b?).e” (by ГЬ?) 


A function F is defined by F(x) =a, x <0, Ех) = be се? x>0 


where a, b, c are constants. Determine these c i 
ea, b, c | onstants so that F is istributi i 
and find p.d.f. and tri-mean of the distribution. ао 


[Ans. Fn е Д] 1 (х2 0) +01 (x <0), р = (т/2)!?, m, = (20n2)'?| 


. Е L D . Р = 2 
A variate X has the distribution: P(X < х) = 1-е QE T TR ur. 


Find the median of the distribution and show that 2m —m igs уң (2/ x) 
о = т2/ П 


2 . 
where m, mp, о” denote respectively mean, mode and varianc 
udi | е of X. А 
skewness of the distribution. X. Determine also the sign of 
A variate X has the c.d.f. : F(x) = 2ax/(a? +x’), 


Show that E(X) = a(l- п, 2), Var (X) = a^ (x — 3) —(1- 0, 2)?] 
Deduce that E(X) = 3a/10 and Var (X) = 2/20. 
The c.d.f. F of a variate X is : F(x) = 1—exp(-a tan x), 0€ x « 7/2, 0 
: - € « 1. 


Prove that mode = 3 (x — sin! a), median = tan! (a7! dn 2) 


Show also that the differential Eq. satisfied b . 
q y the mean p is (Ааа?) 4. = o7. 
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22. Target pee rai parts A, B, C. If ashell hits T, then P (shel hits A) = p, P(shell hits B) 
ine E. "^ E P'. [p + 2p' + 1]. Two ог more shells to hit оор om мету" out 
E E Fn C are collectively independent events. One hit at A, or one hit 

gh to destroy T. Let X denote the number of shells whose hitting 


T destroys it, the lesser number of i 
; , S of shells fail t ALA SAO A: at 
ee and fübdel value. o destroy T. Calculate the c.d.f. of X, mean, 


Ans. f(1) = Y PN 
| ns. f(1) = p, f(2) = 2p'q' ..., f(n) = Ap"! q', p =(2/p')-1.0° = 2p'1q'] 
6-70. Moments for Bivariate Distributions 


The (r, s)th joint moment of (X, Y) about the point (a, b) is denoted by H;, and is 
defined by 
Bl uS ЕК9) Qf -5))rz9,12,3.,5270,1 2, «: (1) 


x For the particularly simple point (0, 0), it simplifies to p, , -E(X' Y`). 


© Notice that. pio - EO. но. EQ). po; = EX) но =Е(@ pi, = ECXY), ete 
- The (7, s)th joint (mixed) moment of (X, Y) about the point (Hio Ш.о) 7 Qoo By). is 

: denoted by H,, and is defined by 

= E(x n, Y u SE Yo) DG X uy =Y -ну],75=1,2..; а) 

_ та particular, Ho = Var(X); ноз = Var(), pio 07 Ho. 

] 6-11. Covariance and its Operational Properties 

_ The covariance between the r.v.s. X, Y is denoted by Cov (X, Y) or oy, or pj, 1 and is 

еу 

ox o, = ELK po f -h)I- EGG). D =X aso =Y -prl 

‘A. Cov (X, Y) = E(XY)-E(X)E(). — [Short-setter] 


2. Cov (X, X) = Var (X). 

3. Cov (X, Y) = Cov (Y, X) [Commutative law] 

4. Cov (X + Y, Z) = Cov (X, Z) + Cost, 2). 

И Cov (aX + b, cY + d) = ac Cov (X, Y). 

. Cov (aX + bY, cX + dY) = aco} + Расу + (ad + be) © yy. 


l. Cov (aX + bY, cU + dV) = aco xu + ado y, + be Gy + bdow- 


Cov (X, Y) = 0, if X and Y are independent ; 
ofs Here Lin E denotes "Linearity property of E", рх 
ov (X, Y) = ЕКХ = n) 0 - By = EDO – Xi 7 Teac * нањ) 
= E(XY)- E(X) Hy — E(Y) рх + Hx Hy -E(XY) -EQO EQ. [ons E] 


converse is not true. 
= Е(Х), Hy = E(Y). 
[Def. of суу] 
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2. Соу (X, X) = E(X Xp) - EOS = Var(X). 
X,) = Cov Y, X). 


[Z -ECOI! 


3. Cov (X, Y) = E(X,. Y) = Е: 
4. Соу (Х+ У, 2) = E (x + Y) -Е(Х + Y)] 


= Ех +) - Qu +002 2) [by Lin E] 


= ENX, + Y) Zp] - ЕХ, Zo + Yo Zo] = E(Xo 20) + EM Zo) [Lin E] 
5. Cov (aX + b сҮ + d) = E([(aX b) - E(aX + b] [сү d) -E(cY + d))) [by Def} 
= E([(aX + b) - (any + РИСУ + d) - (сиу + 00 [by Lin E] 


[by Lin E and def.] 
Cov (a, b) - 0. 


E (aX, .cY;) = acE(X, Y) = ac Cov(X, Y). 
Cor. Cov (aX, сҮ)  acCov(X, Y); Cov(X,a) 20; Cov(a, Y) =0; 
6. Cov (aX + bY, cX + dY) 

= E{[(aX + bY) — E(aX + bY)].[(cX + dY) -E(cX + dY)}, fet, yy) 


E([(aX + bY) – (ару + buy) СХ + dY) – (chy +dyy)}} [by Lin E] 


E[(aX, + bY,) (cX; + dY,) = E[ac X; + bdY; + (be + ad) X, Yo] 


ac E(X) + bd E(Y;) + (bc + ad) E(X, Y), [by Lin E] 
ac Var(X) + bd Var(Y) + (bc + ad) Cov (X,Y) [by Defs.] 


Cor. Var (aX + bY) = a'Var(X) + b? Var(Y) + 2ab Cov(X, Y) 
Letting c = a, d = b, and using Property, 2, the result follows. 
7. Cov (aX + bY, cU + dV) = E([(aX + bY) - E(aX + bY)][(cU + dV) — E(cU + 4V)]). 


= Ef[(aX + bY) (apy + bay [(cU + dV) (cpy -dp,)]), ^ [by Lin E] 
= E[(aX, + bY) (cU, + dVy) =Elac XU, + ad Х,У, + bcY,U, + bdY, V, ] 

0 0 *0 
= acE(X,U,) + adE(X, V) + bc E(Y, Up) - bdE(Y, V,), [Бу Lin E] 


= acOyy * ad oy, * bcoyy + bdoy. [by Def. of Cov] 


Cor. Let U = X and V = Y, the result (6) 
, follows les f | 
flow out instantly by suitably defining the SO ad Een s from (2) to © 
variables. 


8. Cov (XY) = E(X, Yo) - EG) EQ) = O[X &Y indep and E(X — " =0] 
The converse is not true, see Example 5-16 и-н 
6-72. Covariance оў Linear Combinations 
Let Xi, X35, i12, K, and Y, Ff $3 

UN i I» =» Y, be jointly distributed random variables with finit? 


variances. Further, let с, = Cov(X,, Y 2 
: i 1j). 0; = Var(X,) and define 


6- . . 
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S = d 7 , T 
aX, +а,Х, +...+а X 7 bY, + bY, +... + b, Y, ; then 


тт? 


Соу (5, T) = У У арс tL) 


: e CP ES l ia 
t=! j=l 


m i-l 


Var (S) = Sa? ` 
(S) 2a, ©; +2} У a; a; Oj. 5627 
i22 j=) 


Proof. We have, with obvious ranges for suffixes i and j 


E(ST) = E(ZZab,X,Y)-XXajb; Е(Х,Ү), [by Lin E] 
E(S) E(T) = [Za E(X,) [Z5 E(Y,)] - ZZa; b; E(X, EY) 
Cov (S; TJ = E(ST) — (S) E(T) = 2 Dab, E(X, у) - EX) EM] 


Za, b, Cov (X, Y,). 
This prove (1). Now take m = n ; X, = Y, b, = а, and the result (2) follows. 
6-73. Covariance Matrix and Correlation Matrix 

Let 6; = Cov(X,, Y;), с, = Маг(Х,) -0;, p; = Corr(X,, X;), pj = 1. 

The covariance matrix [с] and correlation matrix [p;;] are defined by 
oa oes On Pu Pn c Pin 
Се 


[с;] == 
Ол? ЗФ, О un Рл р, ses P 


On 
Example : An urn contains a white, Б black and c green balls ; (М= a * b + c). А ball 
is drawn from this urn. The random variables X, Y, Z are indicators of the events 
{a white ball}, {a black ball} and {a green ball}. Evaluate the correlation matrix. 
Solution. Write f(x, y, z) = Р(Х =x, Y = y, Z = z}. Using definition of indicators [e.g. 
X=1 if white ball drawn, X = 0, otherwise, etc.] we have 

50:0 0) = 0 41,0, 0) = iNew Ol, Q) es b/N, =~ FO, 0, 1) М 


Al, 1,0) = fll, 0, 1) = 80,1, 1) = Al, 1, 1) =0. p, = fU. 0, 0) = aIN, py = BIN, р, = CIN, 
o? = 51,0, 0) . f, 0, 0) =a/N [1— (a/N)] = а (b + OIN? -0 = bla + QIN? . o7 = cla + БИМ. 


T 6-0-0 e Dt 


Similarly, су, = -bc/ N^, oz, =ас/ №. 
E С xy Ta 3 Jab UNE Мс xou T ЖЙМЫ 
E субу (atc) (b+e) Ра [b+ a) (c a) Pax * (e b) (a * b) 
1 —Jab[ (а + с) (b+c) —Jea/J(c + a) (a+b) 
| 


—Jbe/ f(b + a) (c +a) 


|: qu 1 Es [p;] = Рух ; 


Pzx Pzr 
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6-74. A Useful Theorem 
Suppose (X,, X5, ..., X.) „5% (pi o^). If X= zx, [n then 
(a) E(X) =р, (b) Var(X)- o^ /n () Соу (Х.Х, - 0-9. 
Proof. We use ‘Lin E’ repeatedly, if need be : 

) E(X) = E((X, +X, хои Qm EQ) *EQG) * FEM 
= (u*p-..-u)/n-2nyu/n- p. 


(b) Var(X) = Var ((X, +... + X,)/n] = (1017) Var [Ху +... + Xj 


zi 2 
= (Ln?) [Var (X,) + Var (X5) +... + Var (X, yz aum) (e? +o *..*0] 
= no^/n? = с2/п 
(c) Cov(X,X, -X) = Cov(X, Х,) - Cov(X, X) 
= LCov(ZX, X) - Var(X) 
- * Cov(X, + Z'X,, Х,) - [7/n], [Xj contains no Х,] 


1 {Cov(X,, Х,) + Cov (£'X,, X,)) - [o? /n] 


1 [Var(X,) +0] (с2/п) = (07/n) – (с/т) =0. 


6.75. Worked-out Problems 


Example 1. If Х|, X, are independent variates with means p, ц, and variances с2, с>, 
then 
Var (X, X) = of 03 + pi о; + p3 от. 
Deduce that : Var (X, X,VE(X,) E(X,) = Cy Cy + Cy + Cy 
where C; = o/H; is the coefficient of variation of X; = i = 1, 2. 
Solution. Since X, and X, are independent, E(X, Х,) = E(X,) E (X,) = ird 


E(X; X2) 7 E(x; )Е(Х3)= (01 + щш 1) (с2 + n2). [ns = ТИ " u^] 
1 
Var (X, Xj) = E(X? X2) - IEQG XD = (с? +p?) (o2 * u3)- (p, p)? 
IT'2 
Var (X, X) = 0162 +H} 93 * р сї. (1) 


Dividing both sides of Eqn. (1) by u? u? we get 
Var (X, XDIE (X) ЕХ) = Cf + C2 C2 4.02, 
Note. Var (X Y) = Var X Var Y > uy = 0 = py. [Ind (X, Y)] 
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$ Example 2. A box contains N = 2" tickets among which "C, tickets bear the number 
' Т «ks n]. A group of m tickets is drawn. 
their numbers. 


among which «s tickets bear the number 
Find the mean anid variance of the sum S of 


! à 4 n g 
1 4 Solution. There is (o) = | ticket bearing numbers; (") = n tickets bear number 1, 


3 | 
0 = n(n = 1)/2 tickets bear number 2, and so on. Let X; be the (random) number on 


the ticket drawn on the ith occasion (i = 1, 2, ..., m). Then 5 = X, + X, +... + X,,. Now 


Р(Х, =k} Dz (Ey O<k<n. ERA 


ilem Pn ae “ж Z a+" =F: w 
E(S) = m К ) = mn/2. 


Tc Io find Var (S), we require EG ) and Е(Х, X), i +j. Now 


N ERTE 
a A2 2" DE AT j 2" 2, KAD угол m ] 
2 nn-l) 

2" 


E(X;) 


ey 2 dica 1 ni _ п(п+1) 
f М = ) ty is 4 


Var (X) = [n(n+ 1)/4]— (п? /4)2n/4. (4) 


рее IVar (К) € 2X X Cov (f, xe No? + NW - D ej 

= const ; Var (Sy) = 0, whence 6; = -o 2N — 1). Using o? = n/A, N = 2", we 

Ed (2" — 1). 

= Ў var (xi) +2'5 Y Cov (Х;, X;) 

t=) jeit*l 

Б; mn ie n тп nm(m-l mn|, m-l 

| E EU" ^» — = — - ——— = || ——— |. 
4 d (30s lo dl (д 74). 52789 

le 3. x a Lm m tickets are drawn at a time out of tickets numbered | to л. 
sxpectation and the dispersion (variation) of the sum 5 of the numbers on the 


i 
- v: 
~ 
x3 
| 


t X, denote the number on the ith ticket drawn. Then 5 = X, + X; +... + X, (1) 
aluate E(X,), Var (Xj) and Cov (X, X 3). By definitions : 
Бо) = хрх = EX, -Q/m 243+. m= at D. 


E. 
| 


B Ea 
(hon 


E(1/n) (12 + 2° + оп?) = (п +1) Qn 1)/6. 
Е(Х?)-ЕҢ(Х,)= (п? —1)/2 


m 


a) 
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x ox* 1 6" | E X У x zl 
E X) T A © (Ex)(Xxj)7 n(n- 1) РУР | 


„Пп n-i п(п-1) jei 


n(n — 1) E(X, X) Ex)! – (5х2) [no DP. – [n(n + 1) Qn + )/er 


n(n +1) (3n? —-n-2)/122 n(n + 1) (п — D (3л + 2)/12. 


E(X; X) = (n+ 1) (3n + 2)/12. 


| +10 (30+ 2) (tly __ (n*D 4) 
Cov (X; X) = E(X, x)-Ex)Ea = T = 12 ce 
Thus E(S) = mE(X;)=4 m(n 1). [Lin E & by (1)] 
Now, Var (5) = XVar(X)-2ZEZCovX,X, 0+0 

i=l 


t 


m(n? — 1) m | зүн. 20 т(т — 1) & (3 
12 «(2 - j o Ok Зна С. B o 


m(n + 1) (n — т)/12. 
Comments. We can trivially find out с,. Take out all the tickets. 


Var (5) = EVar(X,) x 2 ECov (X, X;) - no^ + n(n - 1) с. 


Now S, = const, hence Var (S,) = 0, whence 6; = 02 /(п– 1) = – (п + 1)/12. 
However, the method above has its own merit, it shows rich evaluations. 

Problems with Solutions Provided at the End of the Text 
1*. Is it possible to have data : Var (X) = 2 = Var (Y), Cov (X, Y) = —3 ? 
2*. Simplify Q = E(XY +Y)-E(X + 1)E(Y), when X and Y are not independent. 
3*. If X and Y are indicator variates, show that 

Cov (X, Y) = 0 iff X and Y are independent. 

4*. A deck of n numbered cards is throughly shuffled and cards are inserted into 7 


numbered cells one by one. If card “К” falls in the cell “К” we call it a match. Find 
the mean and variance of the number of such matches. 


5*. A bag contains 7 white and m green balls. If k balls are drawn one at a time 
wihtout replacement, find the variance of the number of green balls drawn. 
6*. Lottery model. Suppose a box contains N tickets numbered Vis Vas ..., Vy: А random 
sample of n tickets is drawn without replacement. Find the variance of the sample 
mean. 
Exercise : A bowl contains N chips numbered from 1 to N consecutively. A random 
e п is drawn wihtout replacement. Show that the variance of the sample 


sample of siz 
mean is o?[(N —n)/n(N - p] where o° is the population variance. 


че 
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Exercise 6(d) 
1. Let X and Y be two variates with finite variances, Show that Cov (X, Y) < = 
2. Let X and Y be two independent non-degenerate variates. Prove that 
Var (XY) = Var (X) Var (Y) iff E(X) = 0, ECY) = 0), 

3. If X and Y are i.i.d. continuous r.v.s, show that X — Y has a unique median equal to zero 
4. If X and Y are i.i.d. variates, show that X — Y is a symmetric variate. Give an example to show 

that the result need not be true if X and Y are not independent. 
5. Mark true or false with reasons for your answers : 

(a) Cov (X, Y) 0 => X and Y are independent. 

(b) If Var (X) > Var (Y), then X + Y and X — Y are dependent, 


Д 1 (c) If o; - 0; and if 2X + Y and X — Y are independent, then X and Y are dependent. 
(d) If Cov (aX + bY, bX + aY) # ab Var (X Y), then X and Y are independent. 


6. Find H; for the following jointly distributed variates : 


(a) f(x, y) = 12xy (1— y), O< x, у<1; f(x, y) = 0, elsewhere. 
(b) f(x, y) -4x(1- у), 0<х, y<1; f(x, y) = О, elsewhere. 


оло, y) = 9^x exp [-Ox(1+ y)], x > 0, у> 0,0 0; f(x, y) = 0, elsewhere. 
| (d) f(x, у) = 24xy, x 0, y 30, x - y € 1; f(x, y) = 0, elsewhere. 
(e) f(x, y) = 6xy 2— x у), 0< x, y <1; f(x, у) = 0, elsewhere. 
[Ans. (a) 12[(r +2) (5+2) (5+ 3, (b) 4[(r+2)(s+ D (s 2)", 
(c) s ! (r— s) 1/0”, (d) 24B (r * 2, s + 3)/(5 + 2), 
|... (9 6(r*2)' ((r*4) (r+ 3) | (5*2)! - (se 3). 
__ 7. Let X denote the number of occurrences of an event А in n independent trials. Find Var (X) by 
= reasonable assumption about probabilities. 

8. A train consisting of N boggies arrives at a railway shunting yard. Out of these boggies, n, are 
bound for D,. (destination) n, are bound for D,, ..., n, are bound for D, (n, +... + n, = N). The 
loggies are coupled at random along the train regardless of their destinations. If two adjacent 
boggies have the same destination, they are not uncoupled, otherwise they are uncoupled. 
Let X be the possible number of uncouplings. Find E(X) and Var (X). 

- A freshman dormitory contains 101 black and 300 white students. If room-mates were assigned 
strictly at random, without regard to colour, show that the mean and variance of the number of 
= Students having white room-mates аге 303/4 and 14-2 respectively. 

0. Two similar decks of n distinct cards each are put into random order and matched against each 
other. Prove that the probability of having exactly r matches, is given by 


1 ЛР k 

ор.) r (-1) /k!, r x 0,1,2, ..., A. 

r! k=0 

. Hence prove that the expected number of matches and its variance are equal and are independent 

of p f [3 

Ar ins p^ s T 

An urn contains p" white and д black balls, 

. Balls are drawn on by one (without being returne 
н reached. Let X, = 1, ith ball drawn is white ; X, = 0, otherwise. 


the total number of balls being №, (p +q = 1). 
d to the run) until a certain number л of balls 


at Var (5,) = "P4 (N - n) (№ - D 


Show that Cov (X; X)= —pql(N - [), +7. 
a" is recorded fo for 4, 5 or 6, and a ' – ' for 1, 


А рне » thrown (n + 2) times. After eset pl ie 

МАА. signs forming ап огде псе. To each, except the Ee last sign, is 
месе Ed : MEE г.у. which CUN el, if both the neighbouring signs differ 

е between t ot VEL oe 
6) = Gn- n sn fiiia M > X an are the said r.v’s. Show that Var 
In a lottery containi i - ЖҮ: 
taining л nu 3. ..., n) ; m numbe sare drawn at at 

represent hs a о "| t i Proc ime. Let X 
ем pd ofa mb ) Р Ne та 4 ngs. Prove that E 


(j #k) 


wa mín 
‚д=1 = psp =(n 
A box contains k á ab e | 
varieties of o the number of objec ich variety being the same. 
ye and put back before the drawing. Let n denote the 
es. Find E(n) and Var (л) 


Everything has its limits, iron ore cannot be educated into gold. 
(Mark Twain) 


Appendix: 


Empirical Models 


p-1. Empirical Models 
A probability model is empirical if the probabilities assigned to possible events are 
secured from observations on the phenomenon under study. In the case of a population, 
these are the actual values of proportions in the population under study. For repeated 
trials of experiments, these are taken to be observed relative frequencies. 

© Suppose Xj X», ..., x, are the observed values of a sample of size n from some population 
Then by analogy with theoretical moments, empirical moments are defined as follows : 


| Definition 1. The rth moment about origin of an empirical distribution is given by 
m, = (Xx;)/n, i=1,2,...,n. 

Empirical moments are also called sample moments, since these are based on sample 

values. m/, often written x, is called the sample mean and serves to measure where 


the empirical distribution is centred. 
— Definition 2. The rth moment about the mean of an empirical distribution is given by 


m, = [X(x, -X)]n i-212....n. 
я . 2 ы А > 
The central moment zm, often written 5, 15 called the sample variance, and so s 1s 


called the sample standard deviation (52029, 
quency table with x; 


If the observed values хү, х), = Xn have been classified as a fre 
representing the ith class mark, f, representing the frequency, (i.e. the number of 
observations ; repetitions) in the ith interval, and ^ denoting the number of intervals, 


then the above definitions are modified to 
А 1 h ^ 1 h E h 
(lias. mabe Mia's Li 
і=1 і=1 


temarks. The analogy between empirical distribution and theoretical distribution is 

remarkably preserved if one permits «E(...)" to stand for Èf; (...)/n or Ур; [б] if, 

change E to summation with frequency x observed values. Thus, the geometric means 

G and harmonic mean H may be defined by 

mG = E(inX) = [E f, 0n x,/n. VH =Е[1/ X] 2 [È f, V xn. 
al distribution can be had through the above device from 


Ml other concepts of empiric гап be h 
f theoretical distributions. 


1e corresponding concepts о 
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D-2. Mean and Variance of Combined Sets КС... 
n, with means 11, m, an 


he two sets are merged 


Given two sets of observations with sizes n, 
сї and o2; required to find the mean and the variance when t 
together. 


‚ with corres 
Let the elements of the two sets be denoted by the symbols x, and y; WI р 
frequencies f, and 8j ; then the definition of mean supplies : 


onding 


| з] 
т,= Ў јх т ; m, = Lg, yn, = 1,2, 000 }=1,2,... (1) 
osite set. After the merger, the 


2 ‘ 
Let m and с“ be the mean and variance of the comp | | 
ais n, + n, SO 


composite set consists of the elements of the type f; x; + 8j Yj A ем 
the definition of mean yields. 


m= E(f x, * gj y) (n +m)=(nm + nj т) (n, +m). [by (D] (2) 


2 2 

Variance. For ће composite set we have to consider the terms of the type Fi Xj + 8;Xj- 
Using the formula ц, = цу —u/?, we get at once 

2 


o 
From the individual sets : 


[EC x2 + g; ym + n] - m. 8104) 


[E fxn] m; с; =[2(g, y/n] -m 


Уух? = mím +0); Хе; уў =n, (5 +03) (4) 
Making the substitutions from (4) and (2) into (3), we get 


9; 


2 2 2 2 2 2 2 2 
s men sermon ee (matte = gue nn m -m) 


(nim) eds. n +n, (nj + ny 
Extension. For the composite set which comprises three component sets (n, m, o°), 
1 €i € 3 we readily obtain ЗА ДЫ 


2 2 2 hs 2 5 
тор + Fz +03 „Mm (m —m;) +m m (m, - m) +n n(m, — m) 
n, +m + (нал, n.) 
Extension to composite set of k component sets is now obvious. 


Example : An analysis of daily wages paid to 586 and 648 workers in two firms A 


and B, belonging to the same industry, reveals an average daily wage of Rs. 52.5 and 
Rs. 47.5 with variance of wage distribution Rs. 100 and Rs. 121 respectively. 


(a) Which firm pays out the larger amount as daily wages ? 
(b) In which firm is greater variability in individual wages ? 
(c) What are the measure of (i) Average daily wages ? 
(ii) The variability in individual wages of all the workers in the two firms taken together. 
Solution. The given data, in terms of usual notation is 
n, = 586, п, = 648, m, = 52.5, т, = 47.5, he = 100, ‚2 ЫТ 


с? = 


$D-3. Sheppard's Correction _ Ф 9 
(a) Daily wages paid to the workers by firm A : m, n, = 52.5 x 586 = 30765 rupees. 
Daily wages paid to the workers by firm В: m, n, = 47.5 x 648 = 30780 rupees. 
Obviously, the firm B pays out larger amount per day. 
(b) C, = Coefficient of variation for firm A = 100 s,/m, = 100 x 10/52.5 = 19. 

C, = Coefficient of variation for firm B = 100 sm, = 100 x 11/47.5 = 23.16. 
Since C, > Сл. it follows that there is greater variability in the individual wages of the 
firm B. 

(c) When the two populations are taken together : 
\ _ тт +m, m 30765 + 30780 61545 
Me nem ^ зз5+в6з 1234 


= 49.87 rupees 


E Wü) s? = MST msi, тлобт — m)? _ 58600+ 78408 , 586 x 648 x 25 137008, 293 x 8100 
n +n, (n, +m) 1234 (1234)2 1234 617x67 
= 111.03 + 6.234 = 117.264 


2 з= J117264 = 41173 = 10.82 rupees. 


D-3. Sheppard’s Corrections 


- For a grouped data provided with class intervals, we use 

m, = (Ef х;)/ М, m, = [У ў (x, - X VN, М= 5 

But the mean and variance, and even higher moments of а frequency distribution аге 
calculated on the assumption that all variate-values in each group interval are exactly 
it its centre, which is very roughly true. The resuting errors in the values of moments 
are reduced by using the so called Sheppard’s Correction : 


(m), = ту, (ту), = mj – (h^ /12) 


(mj) = m – т! (А214), (m), =m, – mi (h? 12) + (1/240) 
(m) = т, – (92/12), (т), = т, 
(тц). = т, – (А12) m, + (7/240)һ* 


ere h is the length of the class-interval and suffix c indicates the corrected value. 
rk Sheppard’s Corrections often tend to over-correct and thus replace old errors 
the new errors; consequently these are not much useful. 
ample : Show that if the range of six times the S.D. contains atleast 18 class- 
ervals, Sheppard's correction will make a difference of less than 0.5% in the 
rrected value of S.D. 
on. Let h be the length of class interval, then 6с > 18h (by hypothesis), so that 
5/3. Let the suffix c indicate the corrected value ; then 


(o?)), =°- (h? /12) > o? — (0° / 108) [: h? «o? /9] 


s Blu... 
| 
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l 
—% |o. 
| ) ә 9-9 < 916 200 b | 


py? Dez 
or оз, » o (1- ig) „o| teia 
D-4. Measure of Skewness : S, = (Mean — Mode)/S.D. = (x - 1)/5 


(a) Pearson's first coefficient of skewness (5j) 
(b) Pearson's second coefficient of skewness (5) 

(0,0) - (Q; - 9) 
(c) Bowley's Quartile Coeff. of S, = (О, -Q, * (Q, -Q) О, | 


(Poo — Рю) — (Po = P) | Рю 2Ps + Pio 
(d) 10-90 percentile Coeff. of $, = (Р. — P) + (Pao = Ро) ESX-6L a P. 
90 4 Б 


= 3(Mean — Median)/S.D. = 3(x - ў)/$ 
_ Q, – 20, TU, 


(e) Moment Coeff. of skewness y, = uo. : 
Behold ! We read X(x-bar), %(x-cap), X (x-curl) for mean, mode, median 
Note on Coefficient of Dispersion (C.D.) 

(i) C.D. = (a —b)K(a 0); а= mat (xpo mk. s = EM S...xl 
(ii) C.D. = 1(Q, - О,)/+4 (О, + Q) (iii) C.D. = S.D./mean. 

(iv) C.D. = M.a.D./Average, from which it is computed. 


D-5. Worked-out Problems 

Example 1. For the following data, with given mean = 67.45 find the missing 
frequencies, Modal value and Bowley’s measure of skewness : 

Height (inches) : 60-62 63-65 66-68 69-71 72-74 Total 
Frequency ; 5 18 a b 8 100 

Solution. а+ Б +31= 100 “> a+b= 69 

Since Interpolation formulas for Mode and Quartiles need the boundaries of the intervals, 
we recast the data as under, using y = (x — 67)/3. [Mid-value = 67] 


61 -2 5 ЕТО 
64 -1 18 -18 
alo a 0 
71.5 - 74.5 73 8 16 


0 

1 

2 
лн а 


From у = (x – 67)/3 we get y - (x -67)/3=(0.45)/3= 015. 


Also, у= E fy/ N = (b-12) 2100x (0.15) — b=27 and hence a = 42 
This gives the missing frequencies. 


^ 


Modal value x is given by Interpolation Formula 


59.5 - 62.5 я 
62.5 - 65.5 

3 
65.5 – 68.5 E ч a 
68.5 - 71.5 See yb = 69) 


100 


F-f+F-f) 
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_ НИИ 
where f = Max. frequency (modal class), f, = preceding frequency to d = following 
frequency to f, 

L, = Lower boundary of the modal class, Л = Width of the modal class. 


Here f = a = 42, f, = 18; J, = b= 77, L, ET09.3. h=3 
х = 65.5 + ———É - = 
{ Ba qs 055 +185 = 67.35 


The Quartiles Q;, Q,, Q, are given by Interpolation Formula 
REA 4 UQUA4) - C 
if 
where, L, = Lower boundary of the О, class, М = total frequency. 
C = Less than cum-frequency of the class preceding the О -сІаѕѕ. 
f = Frequency of the Q;-class, h = width of the Q;-class. 
Median Q, Here (N/2) = 50. It falls in Cum-frequency a + 23 = 65 class. 
E = 051, C= 23: qm ауд" 
Q, = 65.5 + [(50 – 23) x 3/42] = 65.5 + 1.93 = 67.43 
Upper quartile Q, Here 3N/4 = 75. It falls in Cum-frequency 92 class 
нов m3 665, f 227 
О, = 68.5 + [(75 — 65) x 3/27] = 68.5 + 1.11 = 69.61. 
Lower quartile Q,. Here N/A = 25. It falls in Cum-frequency 65-class 
L,. =, 65.5, 4.5.3, .C 223,f— 42. 
Q, = 65.5 + [3(25 - 23)/42] = 65.5 + 0.143 = 65.64 
Bowley’s coefficient of skewness S, is 


§, = О О, ~ 01) _ Dit Os -20, _ 13525 134.86 _ 039 _ (оов 


АА PD .. 


ID. —0,: (Q9. -09.....0,—0, 69.61—65.64 — 397 
Example 2. In a frequency table, the upper boundary of each class interval has a 
constant ratio to the lower boundary. Show that the geometric mean G is expressible by 


MG = xj * (c/N) EF i1) 
Where xy is the logarithm of the mid-value of the first interval and c is the logarithm of 


the ratio between the upper and lower boundaries. 
Solution. Here N = Y. f, is the total frequency. f;/N = p; gives Ур, = 1. The frequency table is 


Variable value : (a,ar)(ar, ar?) ... (ar ar)... (а, а") 
Frequency 2). fi» cJ ре canna «de 
We are given that x, = n (a + ar)/ 2, c - inr. Now by definition 
agr ^" ier 
" NG = E(@nX) = >р, пае = Xp, bnr : eo 
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= Урі - 1) пл + [а + ar)/2] EE. а 

= Xp, [(- 1) с+ х] = cx p; (i - 1) + Xo (Хр) = Xo + ДА 4 à 4 > of 
Example 3. For the following frequency distribution, find the moments measure o 
skewness and kurtosis. Is the distribution Leptokurtic ? 


110.0 – 114.9 
115.0- 119.9 
120.0 - 124.9 


125.0 - 129.9 
130.0 – 134.9 
135.0 – 139.9 
140.0 – 144.9 


Solution. The class mark x; is the mid-values of the class limits. We next use codification 
and use empirical formulas corresponding to theoretical (population) formulas*. Let 


у; = (x, – 127.45)/5 => x, =127.45 + 5y; [Mid class-value = 127.45]. Now 


u 7." 200 d У; 
mie уе а 0, | TM IOS Я = 29-036 
‚Хуг _ 1238 _ 1938 
PE pot 


Since m, = 0, Simple Sample moments = Central sample moments for Y. 


*X-21274545Y = E(X) = 127.45 + 5 (EY) 
E(X - py)" = (5) EY - By)’ => (Hx = 5. (Qi. 
Corresponding for samples : M, = (5) m,. 


a. = Pe provides a, = M, > 
Also r с' (M, y 
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For central sample moments M, = (5)' m,, hence. 
M, = 25 т, = 25 (2.06) = 51.5, JM, -717635 


M, = 125 m, = 125(0.36) = 45 M, = 6235 m, ='625(12.38) = 7737.5 
Coeff of Skewness, a, = M,/(./M,) = ae =0122 
i а (7.176)° 


sal 07673 09975 
ОШ POS. "265225 
Since a, < 3, the distribution is Platykurtic not Leptokurtic. 


Comments. If only о, is needed and individual moments p, Hy, p4 for X are not required, 
we shorten evaluations by using | 


a, =( He -(& ; y-X-4 
с’ X с’ Y h 


Example 4. If Pearson S, = 0.32, н = 29.6, с = 6.5 find M, and M,. However, if 
M, = 24.8, what will be S.D. ? 


Coeff of Kurtosis, a, 


= 2.92 


1 = Т; See m 0 = 
Solution. $, = SD. = 0327 65 d Mo 27.52 (Mode) 
= M 6 = Р 
S, = ии) => оз2- 69 = M, -2891. (Median) 
5, = шы = 032- 228 85 > g-15 


Problems with Solutions Provided at the End of the Text 


1*. Show that the weighted arithmetic mean of the first n natural numbers, whose 
weights are equal to the corresponding numbers, is equal to (2n + 1)/3. 

2*. Find the mean and variance of the distribution in which the values of the variate 
X are positive integers 1, 2, ..., n, the frequency of each being unity. 

3*. Show that, if the variate X takes values 0, 1, 2, ..., п with frequencies proportional 
to "С. "Су, "C,, ..., "C, respectively, then the mean of the distribution is n/2, mean 
square deviation about x = 0 is n(n + 1)/4 and the variance is n/4. 

4*. From a sample of n observations, the arithmetic mean and variance are calculated. 
It is then found that one of the values x, is in error and that it should be replaced 
by y,. Show that the adjustment to the variance to correct this error is 

=x ЛГ 
Lo -x)[es + у) „раны 
where T is the total of the original values. 

5*. Show that for a set of positive values of the variate X, the arithmetic, geometric 

and harmonic means are special cases of the pth root of the mean of the pth 

power of the variables. 

For a set of observations : Xj, х), ·-., 


standard deviations defined by $ = Tor - Xy /n, 8? etx: = Xy 1H 21) 


Prove: $ < rIn/ (n - 1) Lo 5 Sf. 


x,, let r be the range and let S,$ be the 
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1. 


10. 


11. 


12. 


13. 


- If G, is the geometric mean of N x's and GC, is the geometric means of N y' 


Exercises 
A variate takes the value a, ar, ar^, ..., ar" ' each with frequency unity. If A, G, H are respectively 


the arithmetic, geometric and harmonic means, show that 


А = a(l- r^)n(l =r), Gar "^ 99. Н =ап(1 nr ! 40 - r^). 


М 2 
Prove that G^ = AH, and also А > G > H unless n = 1, when A = С = H. 
s, then the geometric 


mean G of the 2N values is given by g 2G,. G, 


- If X, is the weighted mean of х8 with weight w; s, prove that 


РЭР w, exp | =; у ш», тр ЖЫ) 


Би! i=] j=l ial 


- Show that in finding the arithmetic mean of a set of readings on thermometer, it does not 


matter whether we measure temperature in Centigrade or Fahrenheit, but that in finding the 
geometric mean it does matter which scale we use. 


- А distribution x}, x,, ..., x, with frequencies f,, f>, ..., f, is transformed into the distribution Х|, 


X», ..., X, with the same corresponding frequencies by the relation X, = ax, + b, where a and b 
are constants. Show that the mean, median and mode of the new distribution are given in 
terms of those of the first distribution by the same transformation. 

A set of numbers are all either 0 or 1. If m of the numbers are | and л of the numbers are О, prove 
that the variance of the set of numbers is mn/(m + ny. 

A sample of 35 has mean 80 and S.D. 4. A second sample of 65 has the mean 70 and S.D. 3. 
Find the S.D. of the combined sample of 100. 

The first of two samples has 100 items with mean 15 and S.D. 3. If the whole group has 250 


items with mean 15.6 and S.D. /1344 show that the mean and S.D. of the 2nd group are 16 
and 4 respectively. 


In a series of measurements, we obtain m, v i ; 
| _ Values of magnitude Xj, m, values of magnitude x,, 
and so on. If x is the mean value of all the measurements, prove that the S.D. is - 


im, (k – x)! Em, ]? — 8? 


where 8 = x — k and k is any constant. 
A student obtained the mean and S.D. of 100 observations as 40 and 5.1 respectively. It was 
later on discovered that he head copied down an observation as 50 instead of 40 m жн 
the correct mean and S.D. . Calculate 
The arithmetic mean and variance of a set of 10 figures are 17 and 33 re : 4 

; 22 respectively. Of the 10 
figures, one figure, viz. 26 was subsequently found wrong and was weeded is the 
resulting mean and S.D. ? out. What is the 
The deviation of a distribution is measured from a value differin 

E ing from th 

distribution by x. Show that if x is plotted against the corresponding mean EE 
the points lie on a parabola. ý 
The sum and sum of squares corresponding to length X (in cms) and weight Y (in gms) of 50 


tapioca tubers are : { 
$3212, Dx = 902.8; Ly = 261, Lyte 1457.6. 


Which is more varying, the length or weight ? 
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Exercises 


| 3 14. Two workers on the same job show the following results over a period of time : 
Worker A Worker B 


Mean time to complete work 30 25 


S.D. of time for completion 6 4 
(a) Which worker appears to be more consistent ? 
(b) Which worker appears to be faster in completing the job ? 


ри а group of 200 candidates, the mean and S.D. were found to be 40 and 15 respectively. 
ter On it was learnt that the scores 43 and 35 were misread as 34 and 53 respectively. Find 
corrected mean and S.D. corresponding to the corrected figures. 
Ac istribution consists of 3 components with frequencies 200, 250 and 300 having means 25, 
» 5 and S. Ds. 3, 4, 5 respectively. Show that the mean and S.D. of the combined groups are 


9:2 E henge 
КА; 


уңа. 


mow hut 


t 


* voor i ne aut 
^5 wi Н py ee 


04 20r qm OK 


төзу baw 


A witty saying proves nothing. (Voltaire) 


Conditional Expectation 


7-10. Conditional Expectation 


Definition 1. Let g be a real-valued function of one variable x. The conditional 
expectation of a function g(X), of random variable X, given A = a < X < b, is denoted 
by E[g(X) | A] and is defined by 


E[g(X)la« X € b] = NC fx (xla « x € b) dx (X : continuous) 


h g(x) лоу [foo ds gx s [воо годах J fa) dx (1) 
If X is a discrete r.v. we define 
E[g( la < X < b] = X g(x) py (x; la < x, $b) = У (х) р(х) Ep), а<х sb. ...(2) 


Definition 2. Let g be a real-valued function of two variables x and y. The conditional 
expectation of a function g of random variables X and Y, given Y = y is denoted by 
E[g(X, Y) | Y = y] and is defined by 


fg, У) fa, Qc y) dx, (X, Y continuous) 
E[g(X, Y) Y2 у] = Ту ах, y) РОХ ox, lY = у), (X,Y : discrete) 


The cases g(X, Y) = X or g(X, Y) = Y merit special considerations. 

Definition 3. Let the two-dim variate (X, Y) have the joint (discrete or continuous) 
density f(x, y). Let f, (x | y) denote conditional density of X and Y when Y = y, and 
f(y | x) denote the conditional density of X and Y when X = x. The conditional expectation 
of Y given X = x is denoted by E(Y | x), [= E(Y | X = x)] and the conditional expectation 
of X given Y = y is denoted by E(X I y), [s E(X | Y = y)]. These quantities are defined by 


f xo lx) dy = ы Xfx y) gy (X,Y continuous) 


Been E NU и | 
Lh, (yl x)= UR. (X, Y : discrete) 
It uno ly) dx = ү х2) ау (X, Y continuous) 
E(XIYzy)* Y 


a Za, y) X, Y : discrete) 
L xf, (xl у) = pro ( iscre 
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Conditional expectation over intervals are defined a 
by its value over the interval. лғ. 
Note 1. If X апа У аге independent, then Bix iY eyy" E(X), әй ED E" 
Note 2. E(Y | x) is, in general, a function of x and is not a random T ii: | ince x | 
a particular value of X. However, it can be randomized by letting х y 
Regression curves : 

(1) The graph of E(X | Y = y) = ф(у), is called the regression 
(2) The graph of E(Y | X = x) = y(x), is called the regression curve 
(3) The graph of E(X | y) = a + By, is called linear regression of X on Y. 
(4) The garph of E(Y | x) = a + bx, is called linear regression of Y on X. 


curve of X on Y 
of Y on X 


7-11. Some Properties of Conditional Expectation 

(i)  E(kIX) s k. (k : constant) 

(i) E{(aX + bY) 1 Z} = aE(XIZ) + bE(YI Z, — [Linear property] 

(iii) E(X 1| Y) = E(X), if X is independent of Y. 

(iv) E(Yg O0 | X) = g(X) E(Y | X), [Pull-through property] 

(у) E(YIX;g00) = EY TX 

(vi) E(E(XIY; Z Y) = EXI”, [Tower property for multiple-conditioning] 
(vii) Cov (X, рух) = Cov OL zm 


Linear Property of Conditional Expectation 

Elag(X, Y) + b A(X, Y) | yo] = aE[g(X, Y) | yo] + bE[A(X, Y) 1 yo] ...(1) 
where а, Ь are constants and g, h are real-valued functions of x and y. 
Proof. The following is an equivalent statement to result (1). 


г [a g(x, у) + РАСХ, y)] f; G1 Yo) dx = a[ a(x y) f Gl yo) dx b f h(x, y) f, Gl yo) dy. 
When X, Y are both discrete, the result follows on replacing integrals by Summations 


7.20. Expectation of a Variate by Conditioning 

Double-Expectation Rule. (Double-E Rule) or Law of Iterated Expectation 
E[gX0] = E{E[s(X)! Y]) provided Eg(X) < о. 

Proof. (i) Suppose X and Y are discrete variates, then by definition 


E(E[gOO | Y]) = EC, 80) Р(Х =х1У=у)) = Y. |х, gtx). Naso 
yy 


= У, g(x). EPX =x, Y = y) = Y, р(х). P(X = x) = Ele(X)]. 
(ii) Suppose X and Y are continuous variates, then by definition 
E{E[g(X) ! Y) = E f^ а(х) G0) dx} = воо д, (у) dy 
А fy) 
= [воо ro. » dy|dx- (^ g(x). f Qo dx = Els OO! 


$7-30. Formula for Conditional Variance 26 5 


—— Se ae Db eum bs А ы A Ж. Ou d ois, s RN bd eee -~ 


Special Case : 
E(X) = E[E(X I Y)]. 


Remarks. If g(X) = », Double = E Rule is not true. To see this, consider p.d.f. of a 
variate Y given by 


(y 2 
dU =, ae) > 0; fly) = 0, у 50. 


Suppose that the conditional p.d.f. of X given y (> 0) is 

Де! у) = ( ЗУ ег? =0 x х<ю,у>0 
Since х | y) = f(x | y), E(X 1 y) = 0; so E E(X | y) exists, its value is zero. 
The marginal p.d.f. of X is given by 


-у(1+х7)/2 
SCA) dy = 


1 D 1 
T nT (+) 9 n(14 x?) 


—/00 < X « 00, 


fos f, HO) ЛОТУ) dy= 


This is the Cauchy density for which E | X | = o». [Example 1(е)]. 
Thus, E[E(X | Y)] exists but E(X) does not exist. 


7-21. Wald’s Theorem on Mean and Variance of a Random Sum 


If X, X», ..., Xy are independent variates with identical mean p and variance o°, and if 
Nisa fandom үт) independent of X; then setting Sy = X, + X; +... + Xy, we have 


E(Sy) = E(N) EX) (П) 

Var (Sy) = Var(X) E(N) + Var(N) EQ). wel 

Proof. E(S,) = E[E(S,'! №] [By Double-E Rule] A 
E(SyI N 2 n) = E(S) = E(X, + X, +... + X) = пр, [E(X)) = p] 

E(Sy) = Е(МЮ = E(N) = ECO EW) (1) 

Now, Var(S,) = E(S? y - E*(Sy) (Computational formula) E 

E(S,) = ELE(Sy | N)] [By Double-E Rule] fii) 


E(S}I N =n) = Е(52) = Var(S,) + E(S) = по? + (ny Ге р = tH 
Е(521№) = №? :Nà => Е(52) =E(No? + N^?) = o? E(N) +p? EN?) ...(4) 
From (1), (3) and (4) we obtain 
Var (5,) = 6E(N) + p2[E(N?)-E°(N)] = Var(X) ECN) + Var(N) E(X). 42) 
Comments. Results (1) and (2) сап be quickly had by MGF method. 


7-30. Formula for Conditional Variance 

Var(X) = = E{ Var(X | Y) + Var( E(x | Y)s Lait (cond. variance) * Var(cond. mean)...(1) 
SCA 

Proof. Recall : Var(Z) = E(Z) - (EDY (A) 


Var (X | Y) = EX! 1 Y) - EXI Y) [Replace Z by X I Y] 
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So E {Var (X1Y)) = Е{Е(Х? Y)} -E(E’(XIY)} = E(x’) - E(EXX 1 Y)) [By 
We replace Z by E(X | Y) in (A) to obtain 

Var(E(X | Y)) = E{E%X | Y)} - [E | E(X | Ff. = E(E(X | Y)) - E^(X) [By Double-E Rule] ...(3) 
Adding (2) and (3) : E(Var (X | Y)} + Var {E(X | Y)) = E(X)) - E*(X) = Var(X). 


Double-E Rule] ...(2) 


7-31. Formula for Conditional Covariance 
Cov (X, Y) = E[Cov (X, Y) I T] + Cov [E(X | T), ECY T)] = mean (cond. cov) + cov (cond. means). 
Proof. суу = Cov (X, Y) = E(XY) - E(X) E(Y) [Easy cutter] (1) 
= E[EXY | )) - E{E(X | T)} E(E(YI T)} [By Double-E Rule] 
= E[Cov [(X, Y) | T]  E(XI T) E(Y1 T)] - E(E(X | T)} E{E( | D]. [by (1)] 
= E(Cov [(X, Y 1 7)]) + E(E(XI Т). EC I T)} - ЕГЕХ 7)] (E(EQ | 7)]] 
= E(Cov [(X, Y) | T]) + Cov [E(X I T), EY! T), [By Easy Cutter] 
Remarks. Setting Y = X, using Cov (X, X) = Var (X), we recover the formula for the 
conditional variance $7-30. 
1-32. Correlation Ratio 
Definition. The correlation ratio of Y on X, written ny y is defined by 


пух = (Var (uy oy} 
Similarly, yy = Lye [пуу ЕСУ l'X)] LER 
Relation between correlation coefficient and correlation ratio : 
| Pyy! < min{ny y, ny y) E 
Proof. As pyy = Py, xit suffices to prove that eh u$ us ^ 
Step 1. Cov (X, ny, x) = Cov (X, Y) [$87-11(vii)] 
Step 2. C-S Inequality : [E(UV)? < E(U^) . E(V^). [$ 10-14] N (3) 


Take U = X- uy, V = By x- E(uy)y) = yy - Ну; 
E(UV) = E(X - ну). (tyi x - Hy} = Cov (X, цуу) = Cov(X, Y) = б 
2 oxy < (ох) (oj, 
Step 3. Divide above by бу 5c a oom 
Pxy $ (Cud Or Ny, x > Pry ух. 


7-40. Computations of Probabilities by Conditioning 
The Double E Rule E(X) = E[E(X | Y)], in summation form is 


E(X) = У ЕХ | Y) P(Y = y)Y : Discrete; E(X)- f EY) fy) ду Y : Continuous MM) 
Now, let A be an arbitrary event and define the indicator variate X by X = I" Tf A occurs, 


d X 2 0, if A does not occur. This provides, E(X) = P(A) as well as EXIY-y- 
"T IY= y) for any variate Y. Hence (1) can be rewritten as 
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2, P(AlY=y)P(Y=y) Y : Discrete 
P(A) = i y) P( y) Iscrete "^ 
b. P(AlY = у) №, (у) dy Y :Continuous 


This method is purely algebraic and does not require to consider geometric regions of 
the plane in order to obtain the limits of integration. 

7-41. Double-E Rule, Cov (X, Hy ү x) and Tower Property 

(i) E(X) = E[E(X I Y)], (ii) E[E(X | Y, Z) | Y] = E(X | Y). 

Proof. Assume that X and Y are jointly continuous. Then using definition of E(X), 


E(X) = D Lr 2, F(x, y) dy dx - [^ fix x 4x | dd 


=|. ings Xf, (x1 y) ах fy dy» [^ [Е(Х1у)] iO) dy = EIE(X YI. 


Aliter. Steps in the above proof can be reversed also : 


Em = Гоа |" ay f, y)dy| ax = Ж Ufo» 0) dy} ах 


= f. UC reel art љо) = f^, {EOI} f) dy = [^ 6-0) dy 


-E($ ()) = Е(Е(ХТ Y)). 

(ii) Cov (X, р, y) = E(X. E(Y! X)) - EQ) . Е{Е(УІХ)} [Def. of Cov] 
= EE X420) - EQ) ECY) [Pull-through and Double-E Rules] | 
SEQ E(X) E(Y) s Cov (X, Y). [Double-E Rule] 


(iii) Let X, Y, Z be continuous variates with joint p.d.f. f(x, у, z). We shall not use 
Subscripts for clarity, and arguments involved will be sufficient to specify the nature 
of density function. Now by definition. 


E(X | Y, 2) = n af(xly, 2 dx = [^ Seth dy lV), say 


* E(E(XIY,Z2!Y] = E[g(Y. 21Y] 
ы © РО) |р Ж» 1 pL. 

A ета" ‹|® T cL xf (x, y, 2 dx]dz 

Eus zr. f(x, у, z) dz| dx (Assuming change of order in integration) 


ly) dx - E(XIY). 
L Fon fear = f aly 


NS uone —- 
7-50. Worked-out Problems 
Example 1. The joint p.m.f. of X and Y, р(х, у) = Pwy 


uF Ч ry 
area виро 5. P13 = 0, Py, = $, Poy = 9; pa = 6? 


= 1 = aL tM 
P31 9° P32 = 3g s раз = ©. 


Compute E[X | Y = j], for j = 1, 2, 3. 


Solution. The adjoining table shows the given data 
and the marginal p.m.f.’s. Now 

fxly)z fe» үе күү: р, 2 ay ы 

0) ddp ii 


Now consider y = 1, 2, 3 and take note of columns 1, 2, 3 of the table : 


E(X Iy = 1) = 22af(a,)=2[1.44+2.443.3]=2 


EX ly =2)= #2 af(x,2)=6[14+20+3.4]=3 


3 


E(X1y 23) = $ Zxf(, 3) - S [102.1 3.2] 


Example 2. The life times of inverters are identically distributed with c.d.f. and p.d.f. 


as F and f respectively. In terms of F, f and 0, find expected value of the life time of a 
0-hour-old inverter. 


Solution. Let X be the life-time of the 0-hour-old inverter. We need E(X | X > Ө). Write 
A = (X > Ө}. Now 
Fy, 4(@t) = P{XstlaA}, fy 4(0 = Еу (0 
F ,P(XsLA) P(XxrX»08) P(0«Xxr) F(r)— F(0) 
So x Alt) P(A) P(X»8) 17 P(X»8) 6) 
This evaluation holds if t > Ө and equals zero if t < Ө. 
Differentiation yields, 


12 
e 


F(t) 


fyi (D = П FOJ] if 150 


@ 1TH D, 


E: 1 P 
E(XIX29) = |; tfaa dt = роу |, гуа) а. 


Comment. If inverter, installed at г = 0, begins to operate, gets dead at г = Ө, Then 
E (ХІХ < Ө), expected life-time of the dead-inverter, is 


EXIX <0) = ge orf at. 


Example 3. Independent trials, each of which with success probability p, are performed 
until there are k consecutive successes. Find the mean number of necessary trials. 


$7-50. Worked-out Problems 26 9 


Solution. Write N, for the number of necessary trials to obtain k consecutive successes. 
Let M, = E(N,). We find recursive relation between M, and M,  , by using Double-E 
Rule. Thus 


M, = E(N) = E{E(N,1N,_,)} NU 
Now, КОММ, = (IN, | +1} +q E{N,}. ; A8) 
Relation (2) follows, because, if it takes М, ,trials to produce (k — 1) consecutive 
successes, then either the next trial is a success, whence we get k consecutive success 
or the next trial is a failure (probability д = 1 — p) and we must start a fresh for 
objective N,. Now taking expectation of both sides of (2) yields. 


M, = E(N iik 142 gE(N)) M, |+ 1 4 q. М, 


1 1 
4 м, - (2) 2). m 


Since N, = the time of first success is gem(p), with EU y= lip, ie. M,-l/p,the 
recursion (3) gives 


and hence in general, (or by induction process) 


Мел y аре 
m.=(3)+(5) (5) pole = (l= p) р 


Example 4. Variates X and Y take the values 1, 2, 3 along 
with the probabilities shown. Find p, E(X + Y), Var (X), 
Cov (X, Y). Determine whether X and Y are independent. 
Given Y = 2, what is the conditional probability distribution 
. of X ? Find also Var (Y | X = 1). 
_ Solution. Since Y f(x, у) = 1 (Normality), we must have 
10p = sop = 0.1. 
_ Now row totals and column totals represent the absolute 
(marginal) probabilities P(X = a) and P(Y = Б), etc. Further 
X and Y are symmetric distributed. Now 
E(X) = 1(3p) + 2(4p) + 3(3p) = 20р = 2, E(Y) = E(X), so E(X + Y) = E(X) + E(Y) = 2E(X) = 4. 
E(X)’= 17. 3p + 22. Ap + 32. 3p = Зр + 16р + 27р = 46р = E(Y’). 
А Var (X) = EQ) - E2(X) = 46р - 4 = 4.6 4 = 0.6 = Var (Y). 

E(XY) = (p + 2p + 3p) + (2p + 8p + 6p) + (3p + 6p + 9p) = 40p = 4. 

Cov (X, Y) = E(XY) - E(X) E(Y) 24 -2x 2 = 0. 

follows that X and Y are uncorrelated. However, X and Y are not independent for, 
PFX23,Yz3) = р # P(X = 3) Р(Ү = 3) = 9p’. 


Conditional distributions. Obviously, P(Y = 2) = 4p. 


paii? 
P(X = х1 Y = 2) = P(x, 2yP(Y = 2) = Р(х, 2)4p ; P(X = 11Ү = 2) | 
= P(3, 2)/4p = p/4p = 1. 


= P(1, 2)/4р = р/4р = 4. 


УРО, у) y) зує, у) 
Further, Е(УІХ=1) = Lyfolx-D- У РХ) 3p 


9p) 14 
DID SS r?P.14 
Eri peat ze ден n Айу ot: vie mI 3p 3 


2 LEE 
Var(YIX 21) = E(Y 1X2 1) - E(YI X = 1) = (14/3) 4-41 


Example 5. Let f(x, у) = 24xy, x > 0, y > 0, x+y < 1, fx, y) = 0, elsewhere. 
Show that Var (Y | x) = (x – 1)2/18. 


Solution. Here : ДО) 


[ 24xydy212xü- 3), 0<х<1 


f(x,y) | 2y 
f kx) fg КТУУ 


O«y«l-x 


- 2 TA 212 x)* 
f Jui Í, poem 


Now E(Y* Ix) (К +2) 


2(1—x). 
3 , 
Var (Y lx) = Е(У 15) - [EY 9] = 10-9? -4 0-3! 2 1 (x? 

Example 6. The joint p.d.f. of X, Y is f(x, y) = Cxy(2 - x - QNUC уж. l, 


Evaluate E(X | Y = y). | 
Solution. We determine C by normality УУ fx, y) = 1. Now 


Jj oe 
Thus, E(YIx) = EQ^1) = £29. 


ES) = Cyh@x- i! - )àx- c 639 NC 


Си A жаи 
Ld ТОУ) = né БЫ? яе; 
Тһиѕ, Бу бобів, C/6=1 = C=6and (i) thus yields 
ЛО) = 2 foc y) = WA - 3), О<у<]. 


f(x,y) _ 6xQ - x - y) 
Consequently, — f(x!y) О). (4 – 3y) 


6 
So E(XIy) = i X Q-x-: 


(1) 


MMC (2-4-4)- Bag 
~ 4278717 PP ayy Pea, 
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Example 7. Let Rx, y) = 21 x? y 0 exc y < l; fix, y) = 0, elsewhere ; be the joint 
p.d.f. of X and Y. Find the кчы ые mean and variance of X, given Y = у, 0« у < I. 
Solution. We determine the marginal density f(y) 


fy fly) = ies y) dx = 21y? Yi dx=Ty®, 0<у<1. 


foy) 3x? 
fixly)= BO) = "d 
4 T x. 1 eos. M dg з Зу! 
Ec 1)» fit Лата реа Oo, 
Е(Х1у) = 22, EQ 14) = 27- 
Var (X | y) = E(X? | 2 UR ҖЕ НЕД 
ч ar (X | y) = E(X ly)-E*(X1y) ЕУ mls 


Example 8. Compute E(Y | X = x) and m for the joint density 
fix, y) = n(n - 1) (их), 08 О<х<у< 1; Дх, y) = 0, elsewhere. 


Solution. Marginal density / (х) = > Ж y) dy=n(n-1) f (y-3)"? dy=n(1—2x)"'0<x<1. 


EE ibo ЕЗ Еш 


2 Ду! шег ЛО) (E ^3 ia 


; eas y ST. 


J E(YI = тта ч, у(у-х)"7?4у= (n-)f t"? [x e (1— x)r] dt. [y - x = (1 - x)t] 
X 


E PES Lippe 0) 


1 п п 
Ё кх) - nf ха)" dx =n. BQ,n)=——. 


i ne] +Е(Х). vn 
| DESERTI IM 

хап Ие 9. Let fix, y) = 8xy, О<х ту 1 i Ax, y) = 0, 
ind (a) E(Y | X = x), (b) E(XYI X = х), (c) Var (YI X = х). 
lution. Firstly, we determine marginal and conditional 
‘tributions : [refer to Figure above in Example 7] 


)= i. f(x, y) dy = 8x f y dy =4x(1- x’), 0<х<1. 
=f f(x, у)ах = 8у fj xdr=4y°, Osysl. 


HEY 22» EFESE, 
Лоу) = FEY 2х ус суду. AOID= fe 1-х 


y Q) y" 
Since f(x, y) + fx) fy), X and Y are not independent. Further 


k+2 
| raf 2X к м c 
E(x) = f, +a l- x” 
(a) H Eio = 2(1-x° m 1+х+^ EPIX = x)= —;- 
f {59 = т 
2 x(I x 4 x?) 
(b) E(X, 42x) = EV Ix) ату 7 qu ^ [by (a)] 
2 1) 
А 122 40 beer (к aTr 
Var (У = 21x)-E2 BU RUE L M Clun е NE vom 
ar (Y | x)  E(Y* 1x) EY |x) 5 c mp 18(1 + xy? 
Example 10. A variate X has a p.d.f. f(x) = 2x/a^, 0 < x < a. Variate Y has p.m.f. 
P(y) = P((ay/10) « X « a(y + 1)/10}; Om. T. 2 us 


Find E(Y) and P(Y = 8| Y > 7). 
Calculate Ere | X < a/2) and hence find E(X | X < a/2). 


2 20. x0 
Solution. Ру) = Ere ШЫ 7 khen 
a a 


ay/10 100 100] 100 
cine E geras Er negem ms 
PY 281 > 7) = EY Gone Gada 
Now p= Мх) [2-1 | pU 
E(e* ix«£) - [e oe icum ure d [by (1)] 
d 8 [1+ (ае 1) е2? 2 Yt?) 


E| xix «() = Coefficient of г in efe" ix<(4)) 


x март: 1 
= Coefficient of t in —— Lb P ) ah. a аг " 
24 5 1 nS T—— 8 i Nabe? CM ЕЕ; D 


Note. Expression (2) is really m.g.f. of X, conditioned on the region X < 1/24 Шш 
of m.f.g. is fully exploited in Chapter 8. 
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06 — — mc E 
Example 11. Three coins are tossed. Let X denote the number of heads on the first 
two coins, Y the number of tails on the | 


the last two. 

(a) Find the joint distribution of (i) X and Y, (ii) X and Z 

(b) Find the Cond. distribution of y given X = |. 

(c) Find E(Z X = 1), ) py y and py.» 


(e) Give a joint distribution that is not the joint distribution of X and Z in (a) yet has 
the same marginals as f(x, z) has in part (a) 


ast two and z denote the number of heads on 


Solution. We enumerate the values of variates and note that probability p = 1/8 for 
each outcome о, the sample point. 


= P(X=1)=4p=3. 


Le PEN 

AH aU 221X - D wa 4p 4 
PLB' ap ТҮ, ы = ES ЖИЙ 

D. PLEJ p 1 


PELO .».1 
PAUD 2P.1 pz-0IX-)- —— = =z 
4p 2 ép * 


P, Р! 


ae i : 
- 
x< 
Ш 
Ш 
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EB 2 2 = v E € 
S3 (Үс -Oy 797 
(d) Е(Х) = 4р+4р+0=1=Е(Ү); E(X?) 8p * 4p ? E(Y ).ox Y Z 


N| — 


3 1 Ж ууз; 
EXN) = 2p 4p- 3, cov, -(3]-12- 3: Corr (^, 2' 


І 
Е(Х2) = 0p - 2. Cov (x,2)=(3)- | - Corr (X, Z) = 5: 


(e) LetO xe <р. The joint distribution of 
(X, Z) shown in the following table has the 
same marginals as in part (a). Another 
possible solution is 


ЛС, z = fio) AZ 
fO) : 0, 2р), (1, 4p), (0, 2p) 


f) : Q.2p) (1, 4p), (0, 2p). 
Example 12. A fair die is cast 3 times. The r.v. X is the number of occurrence of a six and 
the r.v. Y is the number of occurrence of an odd number. Find the joint distribution of 
(X, Y), P(X > Y) and P(X + Y > 2). Prove that E(X | Y = 2) = 1/3 and Corr (X, Y) = —1/ 45. 
Solution. Step 1. The simplest way to find the joint distribution P in this case, is to 
first find the individual densities of X and Y, which we proceed to obtain. 
The event {X = i}, 0 < i < 3, is a set of outcomes from Q such that there occur exactly 
i sixes in them. Here, P(X = i) means, prob. of getting exactly i sixes in 3 Bernouli 
trials with success-prob. in one trial being p = 1/6. Thus 


ee xm "m 

PX =)=) =E 7 (2), i=0,1,2,3. NT 
Since P (odd eye on die} = 1/2 = p (say), the distribution of Y is 

PIY =j) = («7 v -()8) =(0)(8), j-o.123 NO 


We now fill the row totals [P(x,)] and the column totals [P(y)] of the bivariate (matrix) 

table. 

Step 2. Some entries in the prob. table correspond to impossible events, which yield 
P31 = P327 P33 = Pi3 = Ph = ру, = 0. | 

Note that, e.g. ру = P(2 sixes and 3 odd numbers} = Р(@) = 0. Others follow similarly. 

Some entries are trivially obtained, e.g. 


| 3 
ру = P(X =3,Y =0)=(2), Pos = P(X =0,¥ =3)=(1)' 8 


| 
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Step 3. Some entries need auxiliary evaluations. Thus е : 
Р» = P(X = 2, Y= 0) = P(Y = 0) P(X = 21 Y = 0) = (1/8) P(X 2 21 Y = 0). 
Now P(X = 21 Y = 0) = P (draw 2 sixes from three items (2, 4, 6}, with replacement and 


wine ~(3(3) (3-3 


Thus, Pr = 7373€ 
Likewise, p, = P(Y = 0) P(X=11Y=0) 


- ((3) 6) 
Pe 157X3/ X3/ 18° 
Now Po, = P(X =0) P(Y=11X=0)= 42 P(Y=11X=0). 


216 
P(Y = 11X =0) = P (one odd number from (1, 2, 3, 4, 5}) 
E 3 2 = A fae бау 36 
= ()« »-()G 97 55 
hs Эйэ 
Hoi F216." 135" 56: 
All the remaining probabilities (entries) can be had from simple arrangements of marginal 


totals. Simple subtractions in the order : р, Pip P12» Poo» Poo Yield all. Thus 


EE 109150 15:2, 1:1 1, .3 1.1 
E 3x" 86 


ees fon 6.77 1 6 37978 3 cl" 97 
We note that P(X = 1, Y= 1) + Р(Х = 1) P(Y = 1), whence X and Y are not independent. 


P(X > Y) = Sum of prob. on and below main diagonal = ++ 3; = 3. 
P(X+Y22) = 1 — P(X + Y<1)=1- [ро + Ро + Piol = 20/27. 
Second Part. P(X = i | Y = 2) = Р(і, 2)/P(Y = 2) = Tipp і = 0, 1, 2, 3. 


i 2:1 TL аю d кыл+ 95,20, 5 2 
^ E(XIY =2) = 0.5 41.5 42.043.0=3.EX)=04-5 65 $557 XO 0r yt tm : 

EY) = 0424+$43=3,EW7)=04 9+ £12 3EXD- + +т;=1. 
Oxy = E(XY) - E(X) E(Y) = -1/4. of = Е(Х?) - EQ = 5/12, oz = E() - EY) = 3. 


"x HE Lady si Duos 
Pr = G, су 45/124314 45 


Example 13. Show that if Z and X are dependent variates, Z can be independent of X 
given Y. 


| ü 8 r3. = 1. 
| y“ Solution, Consider fix, у, 2) = P(X =x, Y 2» Z7 27P d ;0cp,q«Lptd 
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j : chew ъ=, 5 E got 1„ ж 2, Bis. 


2 г Me 
Хх, у) = p q^ а? = pqg” (1+9+9 +..)=P4 


1=у+1 


Ду, 2 = pg Y (D-(y-Dpq^ ^, with above support. 


r=] 


z-i = 
fz, х) = pq^? roeg keia 15752-2; z- $^ 


yzx-«l 


fio) = Xfes y- р^ "(qi ed S24 )2pq' ',x=1,2,3,.. 


y-1 
f(y) = 2, ЈО, у) = (у 1) pq *, y=2, 3, ..., 0 


=з 


z z-] 
Ros У ла Pq "0288 pq? -24..-(2-2]-216-0(G-2) p q^ 


Observe that Л, z) „юмо ; fa, у) # 0) NO), Ду, 2) * AO) fi(O- 
We conclude : X and Y dependent, Y and Z dependent, Z and X dependent 


fiz Vx, y) ERY, Die, Wa pe TE eee 1 y= 2,3, 2-1. 


E(ZIx, y) = Ww we кет РД, [t 2 z— y] 
a= tz] 
2 руза + pitg'' = py (1 —q)' + p(l - 4)? = y- po 

Thus, EZIX,Y)z ЕЗ р a.s. (independent of Х). 
Conclusion. Z is conditionally indep. of X given Y despite the fact that Z and X are dep. 
Example 14. The pair (X, Y) has joint p.d.f. 
Дх, y) = 1 xy on the square 5 with vertices 
(t. 8), (2, 1), 14 2), (0, 1). Determine 
E(Z' |X = x) where Z = X, when X + Y = 2, 
Z= Х?Ү, when X + Y > 2. 
Solution. We designate the regions and the 
intervals indicated in the figure by 

= {(х, у): (х+у> 2) П5) = В, UB, Ü B, 


= (0х, у): (х+у<2) П5) =А, UA UA, 
2 (3, 0) (1, 3 
M = [0.1] -[o. 2] U [5.1] - M, UM, ; = 0) (3,0) (2,0) 


N= N, UN: == UB «xs2]-[.2 


M; М, №, 
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ї+х 2 E Lr d | 
feo dxf, ydy-x, 0<х<1; (х) = 1х fuit ydy x(2—- x), 1<х<2. 


2 ; DAY L3 y 
Et iot x2-«x)1l,.f(ylx ud s = = Íy. 
a f) M n- J yl x) f(x) x ^ T 2(2 — x) ly 


Meee xl, CX, Z =X", +X” y*7, 


EZ 1X =x) = EX, + ХУЧ, ІХ = х) o x EG, 1X =x) x EY H1 X = х), [by Lin E] 


= x I, f(ylx)dy +x" [lyy fM) dy o x*J, +x" J, (say) x1 
f = ПЕ eae [free ALAS, Гр. Гу A] 

= 20у 29} dy 

109 55 р-а, * —— IQ -23 -G- 01, 

4x aC (T 407 x) ! 

= (1, ET "ыз Э) 
» Lu [t ett be үзе 2 B, ly. Iy = B, 9 Bal 

" К e x dy+ |у. dy} [Putk+2 =A] 

= qoe» -0-»], nens IG- - 2-2)'}y, +13 9" -G- 0*1]... 


Substituting from (2) and (3) into (1) yields 


ax 3—-2x 
E(z‘|X = х) = “| 3 (2221) : ГЕ 5] 


xt ао Sess ра (e= ==) 
M ( x Mie. (2—x) Ж: pn оа eS ^ (4) 


The indicator functions pick out the correct expressions for each value of x in any 
Interval. Of course, E(Z' | X =x) = 0, for x > 2. The conditional mean E(Z | X = х) is had 
When k = 1. Thus 


f 4x -6X +30 —20x+9 6x* -WF +322? + 9x 142—154? +6 -x 
E(Z1 x) = (Oy 4 MÀ —— зл | эъ», 
M, N, 


D 122-3) X2—9 


4 2 
[e^ The Variance is given by var (Z | x) = EZ | x) - [EZ T3]. 
the calculations when k = 2 in (4) are left for the reader. 


27B — сешм —__—_—___—— 


As. 


a". 


AT, 
4*. 


a^, 


6*. 


T 


8*. 


9*, 


; the Text 
Problems with Solutions Provide at the End of 


Compute E(X | Y = y) for the joint density 

nye vie, 045490, 0<у<%. | 
Give an MER E(Y) may not exist though E(XY) and E(Y | x) may 
both exist. 
Show that E[Y – g(X)]? > E[Y - EQ | Ху, 
Find the expected number of random digits t 
three consecutive zeros. 
Variates X and Y are jointly distributed 
fix, y)26,ifx!xysx, 0«x«l, Дх, y) - 0, elsewhere. Find E(Y I X = а 


AH 


hat should be generated to obtain 


) and E(Y) 


X and Y are independent variates with integrating densities fy, fy. Compute P(X < Y) 
and find the distribution of X + Y. 

Two tetrahedra with faces numbered | to 4 are tossed. Let X denote the number 
on the downturned face of the first tetrahedron and Y the larger of the down- 
turned numbers. Investigate the following : 

(a) Joint density f(x, y) of X, Y and marginals f, and f,. Are X, Y independent ? 

(b) Construct joint density g(x, y) different from f(x, y) but possessing same marginals 
fy and fy. 

(с) Fy y (2,3) = PIX 2, У $3) (d) p(X, Y) (e) E(Y 1 X = 2). 
Given two variates X and Y with joint p.d.f. f(x, y), prove that conditional mean of 
Y given X, coincides with its unconditional mean only if X and Y are independent. 
Show that the converse need not be true. 

The joint distribution of X and Y is as shown. Determine p and evaluate Cov (X, 9). 


Var (X) and Var (Y). Are X and Y independent ? Find the iti X» 
given Y= 0 and compute Var (Y | X = —1). conditional p.d.f. o 


E 


10*. 


11*. 


. A joint p.m.f. of X and Y is given in the table. 
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Variates X and Y have the joint distribution 


-у -y РЖ pie 4 
EEUU тичУ0<У69. (x == y) 
e“(l-e"), О<у<х, 0«x«o 


Verify that f(x, у) is a bonafide р... and find the marginal distributions of X and 
Y. Also, find another joint p.d.f. having the same marginals. Evaluate : 
fa) ЕГУІХ = х], forx>0. (py PA S2 Y= 2). (c) Corr (X, Y). 


Find the expectation for the square of the distance between two points selected 
at random on the boundary of a rectangle. 


Exercises 


. (a) Let X and Y be variates of discrete type having p.m.f. 


fo y)2G*2y)18, (х, ўу= (1, 1), (1, 2), (2, 1), (2,2); Лх, у) = 0, elsewhere. 
Determine the conditional mean and variance of Y given X = х, when x = 1 or 2. 
(b) Let fx, y) = (х + у)/32, x=1,2, y=1, 2, 3, 4. Find Е(ХІ Y). Are X, Y independent ? 
[Ans. (a) E(Y! 1) = 13/8, E(Y12) = 6/10, Var(Yl 1) = 15/64, Var (Y | 2) = 24/100] 


. Variates X, Y have the joint p.m.f as : 


(x, y) (059) !:*(0010)9 541520) 7 (1,1) ** 2,0). (2, D 
fix, у) p 3p 4p 3p 6p p 
Determine p and find the two Marginal densities and the two Conditional means. 
[Ans. EXI Y=0)= 16/11 ; EXI Y2 1) = 5/7] 


10р 
| > Ss T 
5p 


(i) Find p, E(X), E(Y) and show that 
E(YIX=2)=4/. 
Gi) P(X «21 Y 20)z 0.33, 
PYs1IIX«2)-2 17/20. 


. Let P(X =x, Y = y) = (x + 3y)/24, where (x, y) = (1554132) Q2, 4 (2, 2) 


Show that the conditional mean and variance of X, given Y = 2 are 23/15 and 56/225. 


- Let p(x, y) = 1 ‚ (х, y) 2 (-3, -5), (71, 21). (1, 1), (3, 5) ; р(х, y) = 0, elsewhere. Are X апа Уаге 


independent ? Show that py, 8/4/65 and Var (X | y) = 20. 


. Two variates have the following joint distribution, in which 2a + 2b + c = 1. Are X, Y mutually 


independent ? 
Calculate E(X + Y), Var (X + Y). Also find Var (X | y) and Var U bx). 


[Ans. 2(2a +b), 4(b + 4a) — 4(b + 2а), Var (Xl y= 2) = 4, Var(YI X = 1) 20] 
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7. Letflx, y) 22,0«x « y « 1; ftx, y) 20, elsewhere. 


2 
Show that E(XIY 2 у) = Ly, Var (X1 y) 2 712. 
F « -u(x + y) 2+0: 
8. The joint p.d.f. of (X, Y) is: fix, y) 2 a^ e ut y 


Show that E(XIX + Y «4)- 4. 
9. The joint p.d.f. of (X, Y) is given to be 
fix, y)=k(4-x-y), O<x, у<2, 
Find the constant k and the Marginal density functions o 
density functions and conditional means and show that 
Var (X) = 11/3 = Var (Y) and Cov (X, Y) =-1/36. Verify EX I V) = ECO. | 
[Ans. k= 1/8, f (0) & (0 = (3 - 0/4. f (1 9) = a) 
ere. 


fx, у) 20. elsewhere. 


fix, у) = 0, elsewhere. 
f X and Y. Also find Conditional 


y2(3 — y). 


10. The joint p.d.f. of (X, Y) is flx, y) 22-x- y, 0 €x, y € l, fx, у) = 0, elsewh 
Show that the Marginal densities are / (f) = f(t) = [(3/2) - t WO<t< 1). | 
Obtain the Conditional densities and conditional means of X and Y and show that o, = 
11/44 = oy and суу 1/144. 

11. The joint p.d.f. of (X, Y) is given to be 
Дх, y) 2 9(1 x4 yy2(1 + x)! (1 + у)“, О<х,у<о, f(x, y) = 0, elsewhere. 

Find the Conditional densities and conditional means. 
[Ans. E(Y | х) = (x + 3/(3 + 2х), E(XI y) = (y + 3)/(3 + 2y)] 

12. Let (X, Y) be jointly distributed with density 


(a) fx, y) 2 у(1+ х) * e? * 9-5 ye 20; f(x, y) 2 0, elsewhere. 
Find E(Y | X), Corr (X, Y), F(x, y). 

(b) Дх, y) = К(х+у), O0«x«1,0«y«l; f(x, y) = 0, elsewhere. 
Show that k= 1, E12 = (2x € 3)/(x +4), Py = — 1. FG y) 9 1 ху (x+ у). 


13. The joint p.d.f. of X and Y is f(x, y) = 3x + у), 0« x, y < 1.О<х+у< 1. 
Show that : f,() = (D = 3(1 - 7/2, 0<1<1. 


(а) P(X+Y< 3) = 1/8. (b) E(YIx) = (1 — х) (x + 2)/3(1 + х) 
(c) Var (Ух) = (1-х)? (х + 4+ 1)18(1 + x)? (d) Corr (X, Y) = 83/95. 

14. Joint p.d.f. of variates X and Y is given by 
Ах, у)= 2(06-х-у)) 0<х<2 2<у<4; f(x, у) = 0 elsewhere. 


Show that (a) E(Y1x) = (52 – 18x)/6(3-x) (b) ECY’ I = (78 - 28x)/3(3 – х) 


(О ECLA = 2) 7267 99/88 739 (0) Com Е edi ST “Also, verify that E(Y) = EE(Y ХУ. 
15. Are X and Y independent if X and Y have joint density : 
fix, у) 232,0 « x «1, -(x- 1! <y< РИК 
Evaluate E(X + Y), E(X | Y = 0) and yk X= 1/2). 


Я : =i n m 

16. Joint density of X and Y is fx, y) -y e > e?,0«x«o 0« 
tAE y< o, Sh = y)=yand 

Е[Х21 Y = y] = 2y’. ow that E(XI Y- y) = ya 


17. If fix, y) e e "y, 0«x «y, 0< y<, show that E(X 1 y) = y/2 and EQC ly) = у? 
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B Leta point X be chosen from the interval ] 0, 1 [ and then choose a point Y from the interval 
] 0, x [, where x is the experimental value of X. With suitable assumptions about densities, 
compute P(X + Y 2 1) and E(X I Y= y). 

19. Let: Ќх, у) = 1/та?, x^ + у <а? ; fix, y) = 0, elsewhere. 
Find the marginal distributions of X and Y and determine whether X and Y are independent ? 
Show that Cov (X, Y) = 0, Var(Y | x) = (a? – х2)/3 and Var (X | yy (а? – у2)/3. 
20. Let Х|, X». ..., X, be i.i.d. variates with common density. 
Ах) = (152), 1 « x < оо ; f(x) = 0, elsewhere. Show that E(X,) does not exist. 
Let Y = min {X,, X,, ..., X, ). Prove that E(Y) exists and equals in n/(n — 1). 
21. (a) If Xand Y are continuous variates, show that E[g(X, Y)] = E, (Ey, yg(X, У). 
(b) If X and Y are independent variates, then for any real-valued functions $ and y 
Elo) (Y) = [Ey 600] [Ey w(Y)] 
(c) If V denotes the variance and y = y (X, Y) is any function, then 
Var (y) = ЕМУ, ly (w)] + VIE, 1y QUI. 
22. (a) If E(Y|X = х) = p, where p does not depend on х, show that Var (Y) = E[ Var (Y X)]. 
.(b) Prove or disprove : 
If E(Y1 X) = X, E(X | Y) = Y, E(X) < ©, E(Y)) < œ, then P(X = Y) = 1. 
23. Prove that Cov (X, Y) = Cov [X, Ey, (ҮІ X)]. Also show that o,, > 0 (or < 0) according as 
E(Y | X) is increasing (or decreasing) if all needed expectations exist. 
24. Letfix, y) = ky’, 0 «2x « y «2 ; f(x, у) = 0, elsewhere. Find k, the conditional mean and variance 
of X given y. 
Also, evaluate P(2X + Y < 1) and Р(2Х + Y < 11 X » 1/2). 


[Ans. k= 1, E(X 1 y) = y/4, Var (X | y) = y°/48, p, = 29/1536, p, = 0] 


Exercises 


25. Letfix,y)= e ",y»lxl -o«x«o. 

Show that E( Y | x) = exp (I x1) and Var (Y | x) = 2 exp (1 х 1) - exp (2 I x I). 

26. Choose two real decimal numbers in the following way : 
First a number N is chosen between О and 10. If N « 4, then a second number M is chosen 
uniformly between 0 and 3. If N > 4, then the second number M is chosen uniformly between 
0 and 4. Let X and Y denote the random numbers chosen in the first and in the second case. 
Find F(x, y), f(x, y), E(YI X = 1) and E(X | Y = 2). Also compute 
(a P(3«X«512«Y«4), (b) P(2X + Y « 3), (cO) P(X»212X- Y <3). 


Idealism is what precedes experience; cynicism is what follows. 
А (David Т. Wolf) 


iain be Ce жй 


LI 


There is nothing as deceptive as an obvious fact. (Canon Doyle) 


Generating Functions 
(or Transform Methods) 


8-00. Generating Functions 
For a given collection of numbers (а„ k 2 0), we define 


k 


(0 G(0- Xa; Gi) HL X - 
k=0 ео К! 


which are called (i) generating function of (a,) and (ii) exponential generating function of 
(a,). These were introduced by Euler and De Moivre in the early 18th Century. 
Uniqueness Theorem (Crucial result) 

If G (t) = G,(t) for x, < t « x,, then (a,) = (b,), V n. 


п> 0, then 


n 
Convolution Theorem : If a, = »,cjb, j, 
j=0 


С) = С (0). С,(0) 


8-10. Moment Generating Function 
Definition. The moment generating function (written m.g.f.) of a random variable X 
is denoted by M, and is defined by the relation 

M(t) = M(t : X) = Ete”) ер 
provided this expected value exists for every value of t in some interval — h < t < h; 
h» 0. According as X is a discrete or a continuous variate, the Eq. (1) is written as 


M(t: X) 2 E,fGo)) e", or M(t: X) |? f(x) e" dx (Kernel Form) ...(2) _ 
Where f(x) is the discrete or continuous density funciton of X. Expression (2) is 
sometimes called Dirichlet’s form (series). 


If a m.g.f. exists, then M,(t) is continuously differentiable in some neighbourhood of 
the origin. Differentiating (2) n times w.r.t. ‘ft’, we get 


TEMOSO)" a = ичо | муф] -EQX")- p’ 
x «uf 


From Eq. (3) it follows that the moments of a distribution may be obtained from the 
m.g.f. function by differentiation and this justifies the reason for the name : m.g.f. 
Note : The function My, called m.g.f. of X, assumes for the real variable т, the value 

Xt) or M(t : X). The notation M(t : X) is neater when m.g.f. for combinations like 
aX + bY + с, etc. are used. 
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8-11. Taylor’s Series of M.G.F. about an Arbitrary Point 
The m.g.f. of a r.v. Y = (X - а)/Ь 15 defined by 


M(t 2 Y) == Ее о) [M O= Г.Л) ee Әх or Lf) Pih “4 0 


Differentiating (1) w.rto. ‘? ғ times, assuming interchange of differentiation and Expectation, gives 


A ma:n- gem ae ea mesg zem 
dt! dt’ J 


dt" 
Put г = 0, on either side to get 
Now Taylor's series for any function My(t) is 
M (t)=M (0) + M} (0) MO 15 (r) t! T en (r) г 
y i (0) t + Mj ate t My ФЕТ Ле > My (0). MEN 
i . r=0 T 
Substituting from (2) into (3), we get 
© TH t r © [ "d 
М = ЗЕЕ Еш 
At) Der Ө p p Api ...(4) 
Special Taylor Series : 
| Nc 
(i) М0) = 2, A [MGF of a r.v. X, (a = 0, b = 1) р, = E(X’)] 
.. < H r 
= sa 
(ii) М) p r! [MGF of centered r.v. X — p, (a = p, b = 1) u, = E(X - p)" 
IW 


(iii) тй) = [MGF of standard г.у. (X — uy, (a = ub) py EX- p] 
r , es 2 { E a 


= r! б” 
The series or integral in (1) may not exist, (i.e. not 
» (LE. converge t : | 

values of г, hence M,(t) is not defined for all values of NN a finite value) for all 
always exists and equals 1. . However, at г = 0, m.gf. 
Comments. It is possible that a variate X may nei 

‹ { either po в 
e.g. consider a density : f(x) = Мх, 1€&x« ©; fix) = 0 MEM moments пог m.g... 

, ere. 


Неге M(r:X)- Го / x?) dx. 
For г > 0, this integral is divergent and hence М, (г) d 
r > 1, also do not exist. ХО!) does not exist, 
Example : Show that a m.g.f. may exist without th i 

; е ех 
Solution. Yule's Distribution. Let f(x) = 1/х(х + 1), x = n of moments. 
[Let us write T — е") : PER 


Simple moments н, 


Дх) = 0, elsewhere. 
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M(t: X) Se xri Ут" | | [27 [$T 
TAL ) tal X X 4 | е X ‘i "Т. t | 


© $" 1 | ox Tu og) TA 
гж b ` ^» 
ERST. > 1 1+ (1 ho 
И Е, 


= i T- T 
а ИБ log(1- 7)] =1- (1-е ‘) log (1 — e'). 
С I 
Ifr2 0, МОО) = 1; if «0, le |< 1; so M(t: X) exists for < 0; if > 0, log (1 — e) is non- 
existent and M(r : X) does not exist. Thus mgf M(t) does exist for some values of / (viz. 
for t < 0) but not every f. Since 


ХЕЗ M 


xe 1x1 us x) i xu] X + 1 


it follows that р” and hence all higher moments, do not exist. 


— o, [Divergent Harmonic series] 


8-12. Effect of Linear Transformations on Simple m.g.f. 


M (+) Mtt: — ot , е Г 
охх (t:a* bX)- e^ M(bt: X) (a, b constants) AX) 


Proof. M(t:a J- bX) Æ E[e ^ * 1 Е Е[е“ TU bs e" E[e X | = e" M(bt : x [By Lin E] 
Cor. For a standardized variate X* = (X — p))/o, we have 

M(t: X*) = M[t:(X/6o) - (n/o)] e" * M((t/ o): X]. IN) 
Note. The effect of change of origin and scale on m.g.f. is governed by (1). 


8-13. Linear Combination Property 
If X and Y are two independent variates and a, b, c, constants, then 


M(t: aX + bY + с) - e" M(at: X) M(br : Y) AU) 

Proof. M(t: aX + bY + c) = E[e ^X * 5 +9] = Efe" ee] 
е“ Efe**].E[e””] [ọ(X) and (Y) are independent] 
е“ .M(at: X) M(bt:Y) [by def. of m.g.f.] 

In particular, the formulae for the sum of two indep. variates or a constant multiple are 

M(t:X+Y)= M(t:X).M(t:Y), M(t:aX)= M(at:X). 

Generalization : If X ; аге all independent variates, then 

| M(t:a,X, + aX, +... +а„Х„) = M(at: Х,).М(ан:Х,)... Ман: X,) 
.. The proof is immediate by mathematical induction. 


8-14. Uniqueness Theorem | 
* m.f.g. uniquely determines a c.d.f., and conversely i 
ote. Differentiation under expectation sign (DUES) 
Ми; X) exists for -h < t < h; h > 0, the derivatives of all ord 
* evaluated under the expectation sign. Thus 


ү LI . Li . 
я f the m.f.g. exists, it is unique. 


ers exist at t = 0, and can 
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[M'?(r),,., = M” (0) -ECX^), r positive integer. 


: ; itted. 
Proofs of these results are rather involved, and are om " E. 
Note : If m.g.f. does not exist for all ¢ € ] ~ h, h [, h > 0, then M(t) need not generate 
moments. See Example 1 (Yule distribution). | | 
Example: Show that existence of moments, all or some, need not imply the existence of m f o 


Solution. (i) Consider the Pareto distribution : 


= a? insit] 
E(x") = [ Sart фо р oe A 


0-1 


Е(х)=1- (a/ х), x 2a,0» |. 


This integral is convergent iff r < Ө, and then E(X^) = 00 / (0 - 7), 0 >r. 


ө 

со oo й M 

However : M(t:X)= ge e" dx - 0a? | e" x &*) dy — oo 
e. E 


becuase (e™/x°t!)>x*, for some positive integer k. Thus, m.f.g. does not exist. 
Note : (1) Student's r-distribution and Fisher's F-distribution have moments of all orders, 
(in the domain of their definitions) but their m.g.f.'s do not exist. 

(п) Let X be a r.v. with P(X = x2^y* = 1/п ! (26); n 2 0, 1, 2, ... Then all moments of X exist, viz. 


© 2k 


em n = exp Q2" - 1). 


! 
п=0 "UU 


TT _< (e)! 
E(X 7 )=0, EC) = У 27, =| 


n=0 n 


M(t)= Set PY = +2^у= Э B Chen сЕ ЭШ (2"1) 
п=0 n= 2 n! AU n! f xt 1) 


If m.g.f. of X exists, it is given by (1). However, the series in (1) converges only for 
t=0, which we can verify by using D’Alemberts’ ratio test. 


Hence, ма) is defined only for г = 0 and thus existence of all the moments of r.v. X 
does not imply that m.g.f. exists. 

Properties of M.G.F. : M,(t) = E(e'*) 

. My(0) =1, M(t) > O, V t where M(t) is defined 
. For X 20, M'(r) > 0 and M, (f) 1, For X <0, M'(t) x 0 and М, (2) 4 
‚ MY (0) -E(X*) e ш, k=0,1,2,3.. А 
‚ Муй) =E Ir!) M^ (0) = X(t" 1r!) р =1+ р 
. M(t: aX + b) = . M(at : X) 

: M(t: X + Y) = Mr: X). M(t: Y)if X and Y are independent. 

. Му (2) characterizes the distribution of X under reasonable conditions. 


DIUI oo ^ Taylor series 


чо әль WN o — 


8-16. M.G.Fs of Some Standard Distribitions 


Some frequently occuring probability laws are stated in $3-40 and $3-60. The 


xp «d for m.g.f.s corresponding to some of these distributions are obtained in 
this section. These results are extensively used in the sequel 


= 
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mM(t:X)=E(e” ) = 1 „е“ +0.e°' = 
2. Bernoulli’s distribution. f(x) = g'~* cso) proi 
M(t)=E(e™) — а.е” + p.e' =(q+ pe), [X ~ Ber(p)] 


2'. Binomial distribution. Х ~ Ып (п, р); f(x) = (") 4% i pii x= 0, iP ZA 
X 


LM X)- Ee 2 i, ("\4 "fpe 2, (" ‘Ja ^." (pe) =(q+ ре)". [by Bin. expansion] 
— Note. bin (1, p) = Ber(p). 
e à Poisson distribution. X ~ Pois (А.); К е а=. 


n үх 1 1 . . 
ме :X)=E(e*) = per e" ze Eco = е№ -9 [by exponential series] 


4. Geometric ESL. X ~ geom (p; fix) qp, eS р x 


А bh. à oo оо 
— M(t:X) -E(e"*) = У g pe" = рУ (qe) = Р -erdge det [By G.P.] 
M x=0 x=0 = qe 


is Pascal Geometric distribution. X ~ вет (р); Р(х) = 4р,  x=1,2,3,... 


T :X)- E(e*) = Xa" ! p) е" = ре! > че у=! у -, 14е'1<1. [By GP] 


| Neg -bin distribution. X ~ NB(k, р); f(x)= = iim ЕУ )p pq «(1 pP eg, х=0,1,2,... 


о-в") DIE а" 2 REDI Je = p'(u - qe) *. 


х=0 


: =[р/(1- qe "d 


Pascal N-B distribution. Y -NB*( px. f-(1-1)Pa ука, 


М à k 
И о еру лра ау -I 2 |. 
Nabe") = У-у tt pet (65 Jae =e aee) кз 


| ave used y=k+x. Here Y=k+X, іе. NB* =k + NB. 
ultinomial distribution. 


“M [Ал fs... %)= ae Arg a LE Pi < 


E. тен x Xk Х| +. FAM, 
чт) - X^. „ар eee Рк -€ 


Methods) . — 


i ft 4 pge” +... + Р, 
n уа” (p, е) = (pe' + Pr! 
F -A ATTE e) m 


X 


e" Г. 
; = wit ee F E A 
7. Uniform distribution. X ~ Unif (a, b); Дх) = I/(b ~ a) 


ht at 
a А4 € ~E tt 0). 
M(t: X)=E(e”) = Sr “ке (b — a)t | 


i distribution] 
Note. For U(0, 1), M(t: X) = (е - Vt, t + 0. [Standard uniform 


Note. Frequently we write U = unif (0, 1) i \ 
8. Cumulative distribution function (с...) Y = F(X). X continuous. 


(e 1)  tmgf of unif(0, 1)] 
t 


M(t: F(X))=E(e") = [7 e^ F(x) ах = |е? i" 


Note that F(oo) = 1, F(—oo) = 0, F'(x) = f(x). С 
9. Normal (or Gaussion) distribution. X ~ МХ, с) 
fG)2(oJ2ny! e C07? — exeo, 
е А =x? + ox) x- 
-(x- п) /2e* LI |:- X J 


Шы с CE INL 


Since : — ig + t(p + в) = (uti ot i(z- ot) = (ut + 1 1621?) tu’, [и = z - ot] 


a uo itio Р 
M(t: Х) = ас а (I. ere ee QU [Area under N(0, 1) is unity] 


Standard Normal distribution. X ~ N(0, 1) . M(t : X) = е? 
10. Gamma Distribution. X ~ gam (a, А). f(x) = Ае х! /T(g), x>0,a>0. 


MMe -Ах x*^ 1 e 5 i х F Р 
Р бХ. ОЕ ТЕ Маг) [(, t 
ма ве) = Д тау eam es [е mente To) E i 


Note. gam (1, A) = expo (A), gam (5л, 1) = ус. 
11. Exponential distribution. X ~ Expo (X). f(x) = Л“ 120,250 
a Е СЕ iaa" Kia X "Уа. 
M(t: X) =Е(е" )=f ^e .e ax Af, e a= (1-4) е 
Note (-1/A)Un U ~ехро (А); X ~ехро (А), cX ~ expo (А/с), с> 0 


e"? x07 1 


12. Chi-square distribution. X ~ Xin) S) = ~a x30. 
1 2""T(n/2) 
-x/2 0/71 e I0 21x 2-1 
ме: X3ysE(e » [| ——— — е фр Г(п/2) o? 
жауа 2"? Pini 2) [ 2"? P(n/ 2) Y'nwaq-2/27 . 


13. Laplace distribution. X ~ Lap (qj, А). f(x) = 1А етл ні Сизсә, X ьо. 
мос) [e ende dan f eqs fen ep] 


§8-18. Sums of Independent | Random Variables : Linear Combinations 2 89 


0 ob 
| і! „(А + Эг, f (hate Z А 
L Ae € а: + 2 7 | ‚н! =A + Dy 
;^ - 0 € dz - ; Ac Ü € T ) dy | (i e (^ dz) 


) 


Ш 


Ш 


13e" (1/(A € 0] + (17 (A= 0]] = Me" / (А2 = 1?) е" (1-12 Ау = 32 1? - 0) 


8-17. Laplace Transform 


Let the r.v. X be non-negative. The Laplace Transform of X is denoted by Lap (t : X) 
and is defined by 


Lap(t:X)-E(e ")2 M(-t:X) t>0,X20. 
We shall sometimes evaluate M(-t : X). An extensive literature and Tables of Laplace 
Transforms (L.Ts) are readily available. 


Illustration. X - Expo (a) and Y ~ Expo (b) be independently distributed (a 7 b). To 
find the distribution of Z = X + Y, we use Lap-transform (L.T.). 


S 1 
Mer 2 Mer X Y) Mes X) ocn») (14) ETET NU 
a b b-a\t+a t+b 


Let so E – Б"), a#b O0«z«o. bC) 


We trially find that Lap-Trans of distribution (2) is given by (1). Hence (2) is the 
density of X + Y. 


>) — 8-18. Sums of Independent Random Variables : Linear Combinations 
1. Let X ~ N(p,, 02) and Y ~ N(p,, 03) be independent. Then 
: | (X +Ү)- NQu + H251 +03), 

Linear Combination. Let X ~ N(p,, 5?) and Y ~ N(p,, 53) be independent. Then 


TE (aX + bY + с) ~ N(au, + bu; + c, alo; TREES 


| Li 2. Let X ~ gam (a, А) and Y ~ gam (b, A) be independent. Then (X + Y) ~ gam (a + b, А). 
3. Let X ~ Expo (A) and Y ~ Expo (A) be independent. Then (X + Y) ~ gam 12:20, 


‘Ж 


_ Proof. In each case, we use M(t : X + Y) = MG : X) M(t : Y) and appeal to uniqueness theorem. 
pi. M,(n- gni onum. My(t)= gir Or, M,(t). My(t)= gon te +? — M(t: X +Y) 

| This shows that (X + Y) ~ Ми + и), 9, = о2) 

- Linear Combination. M(t:aX + bY + с) = e" М(а: X) M(bt: Y) = a.m 
| = exp[ap, + bp, с (а?с? & b'o5)/2] 


et * (ау 12) А e «(blo 12) 


a E , . 1 "- 
Thus linear combination of Normal variates are again Normal 


This shows that (X + Y) ~ gam (a + b, A) 


| My)» 0.172) = My(t), My) М0) = 07 197 = Me XD 


d 
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Е ariates is not an Expo vari; 
i i Sum of Expo varia 
This shows that (X + Y) ~ gam (a, A). | 
"a we variates are considered in $8-54 & | 
Note. Sums of indep. binomial, Poisson and geometric є lates аге | 
T tions, 18 
Sum of two Cauchy variates, using Ch. function Ў 
i istri 1: is considere 
Sum of several uniformly distributed variates 15 con 


considered in 89-71 
d in $18-30 


8-19. Worked-out Problems 
Example 1. If. M(t: X) - 2e' 4 1e? 2e", find Var (X) and p.m.f. Eme varia 


Compute р’, as well. 
Solution. The m.g.f. of variate X is given by Dirichlet's form 


M(t) =E(e™) = Ef (k) e", k = 1, 2,3, ... 
Comparing this with the given M(t), equating components, we get p.m.f. 
P(X = 1) = 2/5, P(X = 2) = 1/5, Р(Х = 3) = 2/5, P(X 2 4) = 0. 
We now use Art. 8-10 (3) to find Var (X). 
M'(t)=(2/5)e' + Q/5)e" +(6/5)e", M'(0)=E(X) = 2. 
М''(ї) = Q/ Se' + (4/5)e" +(18/5)e", M''(0) =Е(Х?) = 24/5. 
7 Var(X) -E(X?) - E (X) = M"(0) - [M'(] = (24/5) - 4 = 4/25. 
Note. Using the exponential expansions and collecting coefficients provide 


M(t)=1 5205 Y +2003] 2 ut = 102+ 27 «20y]. 


Thus р’ = 2, р, = 24/5, 0$ = (24/5) 4= 4125. 
Example 2. Find the m.g.f. of logastics distribution and hence obtain its mean and variance 
Solution. Here F(x) = {1 + exp [-(x – p)/k] y". [Logastics c.d.f.] 


f(x) = exp[-(x -pg)/ k]/ КІ +exp[-(x - p)/ k], —-=<п<‹= NU 
M, (t) - E(e") = f e” f(x) dx 2) 
Put етич = и, then а dx = — k du, е" zeu* 


Substituting into (2), we get 


— ree" i" du o yay 
He =} (1+ и)? [ (1 + yy'*^ = В(а, » 


e" BU — kt, 1 + kr) 

e" F(I — kt) ГО + kt), (Гр) '(1— р) = x /sin pz, O « p « 1] 
(a) e"T(p)T(I- р) [р=1- м, г p) = МГ(1— p)] 

e" (ти) / sin (nkt) 

0n M(t) = ш — bn [sin (лг) / Спе) [Expand sin 0] 


кп) 


$8-1 9. Worked-out Problems 2 9 1 


= pr – фп [1 - x??? /31...] [Use (п-ѕегіеѕ 
-yu-rÀà)/62... 
E(X)-k =p,  Var(X)-k, = 97k? /3,... 
Example 3. Find the m.g.f. of the Inverse Gaussian density : 


А s 
i A -AQ = py? 2? " 
f(x)= E J gor ven SOAs i 
2TUC 
1/2 
А E m 2 2 vy 
‚ И ere | tx „—Х(х-ц)°/2хм^ AX "m 222 
Solution. x(t) 2n ae Yu [Put x2y ] 


‚ yn 
C Mn e Ls a d dy 
Since : f ETT r e 20> a0. b>0 


i| 2,7t ^ | qur rie AR 
T EMEN R үз ^I: use’ a =—, b z——-—t 
M(t) 2 exp 5 1 | n | | 2 2и? | 


Note. We can find the mean and variance using cumulants 
2 1/2 3 2 
K(t) = п мо ды) ESN 


Thus k, = E(X) = p, k, = Var(X) = u'/A 
Remark. The variate Z - АХ - p)’ / Xp? ~ xi "iv 


Problems with Solutions Provided at the End of the Text 
1*. Explain why there can be no г.у. X for which M(t : X) = t/(1 — 2). 
2*. Show that for the rectangular dist. : f(x)- ia, -a€ xa; f(x) -0, elsewhere 
M(t: X)=(sinhat)/at. Also, show that the moments of even order are given by 
TANE. a" (2n + 1). 
3*. Find M,(t) when the c.d.f. of X is 
F,(x) 20, x «0; Fy(x) = 1-е", x20. 
4*. If the moments of a variate X are defined by E(X') 2 0.6,7 =1,2,3,..., show that 
P(X = 0) = 0.4, P(X = 1) = 0.6, P(X > 2) = 0. 
S*. Let m(r) =E(e™), E(X) =н and Var (X) = o^. Let M(t) = Е(е") = 


А | . 2 
Find the mean and variance of Y in terms of p and о”. 
* : : "Ae ^ Р 
6*, Variate X has the mixed distribution : 


I(x) = EA Mt О <х <; omitting the integers; f(x) = 0, otherwise. 


g nm 0 att) 
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eut р(х) = ie M 1х, x 20,1,2,... 


i in Var (X). 
L or otherwise obtain p | | 
A A Poe 1) distribution with probability p and MCI, 1) distribution 
: Г.У. i 
with probability 4(= 1 — p). Find Var (X). 


8-20. Joint Moment Generating Function ^ 
Definition. The joint m.g.f. of random variables : (А, 


M y (t, t5, ..., t,) = E(exp [t X, +1,X, Tec LP )] (1) 
2 1 such that -h < t, < h fo 


Bus du is defined by 


provided the expectaion exists for all values of Г, t2 
some 4»0,k21,2,3,.., n and X = (Х|, Xoo ..., X,)- > 
From (1), we obtain the joint raw (i.e. simple) moments by differentiation 


ОМО) куа уз. РУМО t,) 
аара eon) | EI. 


where г = (t,, t5, ..., £,); t 2 0 means t, = 0, t5 «0, ..., t, = 0. 
8-21. Joint m.g.f. and Mixed moments for Two Variates 
The joint m.g.f. of X and Y is : M, y (tj t) S Ее"? ' ]. 
My y(t,0) - Ee") = Mt, :X) — My,(0,5) -E(e^") = M(t, Y) 
Thus, marginals (individual) m.g.f.’s can be obtained from the joint m.g.f.’s by setting 
t,=0 or г = 0. We shall write My, Y(t, 2,) = M(t, t»); M(t,; X)= M(t,), M(t, : Y) = M(t,), etc. 


Moments. Let M_.(t,,t,) = зоа РАС 


ef'(X-ay ery-byl. E | 
- ар pug : |а 


rep РЕМА Д ECT ris! 


x о © AC esc 4 oo py 
3 2% rem a = У aoe 


Thus, E[(X —a)' (Y - b) ]= Coeff. of (ti th /r!s!)in M.(t, t) 

In particular : E(X'Y*) = Coeff. of (г t/ris!) in M(t, t) 
EK р.) (У р, 1 = Coeff. of ( t Arist) in My (ft). 

Cor. Assume differentiation under expectation sign (DUES) : 


a’ +s 
Ot; Of; 


res 


f M 


д 
oe -| a а) (v — py A 


Ot; Ot; 


rts 


д 
as P M,(0, 0)  E((X -ay (y — by ]. 
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8-22. Factor Theorem for Independent Variates 
за jointly distributed variates X and Y are independent iff, for some h > 0 


M(t, t) Mit) M(t,)V t,t, with л: L tech 

Proof. If X and Y are independent, then 

M(t, t2) = Ele" * ^") = E[e^X e^" ] Ее" Ее] [^ ^X and „7 are indep.] 
і.е. M(t,,t,)= M(t,,0) M(0,t,). "ib 
Thus, the stochastic independence of X and Y implies that the joint m.g.f. factors into 
the product of the marginal i.e. individual m.g.f.’s. 
Converse. Given result (1), we need to prove that X and Y are independent. 
Let f, fj, / be the joint p.d.f. and marginal p.d.f.’s of X and Y, supposed continuous. 
Now X, Y have unique m.g.f.’s given by 

M(t,,0) = | fi) е" dx; MO, в) = [^ f(y) е? dy. 


M(t,, 0) MO, г) = f^. f, Gx) edx E f,) e dy = [^]. FOO fO) e" * dedy ..0О) 
Using relation (1), Eq. (2) can be rewritten as 


M(t, t5) {hw fbx) fo (y) exp (t,x + thy) dx dy. om) 
But M(t,, t,) is the joint m.g.f. of X and Y, so 
M(t,,t,)= Fs fs, y) exp (tx + ty) dx dy (4) 


The uniqueness of m.g.f. implies that (3) and (4) must yield 
fix, y) =A (у) = X and Y are independent. 
The proof, when X and Y are discrete, follows by using summation instead of integration. 
Remark. The result can be extended to any number of variates. 
Example : Let X, U, V be indep. variates such that U has the Bernoulli distribution 


PW = 0}= р, P(U =1}=q, p+ q=1,0< p«1, V ~ Expo (А). 
Let Y = pX + UV and suppose that X and Y are identically distributed. Show that, 
(a) The common distribution of X and Y is Expo (A), (b).,Corr. (X. Y) = p, 


(c) Regression of Y on X is linear. 
Solution. Let Z = UV; Now using Double-E Rule, we get 


M(t:UV) - E(e"" ) = E(E(e""? lu)}= E[l- GU /X)Y" ^ Em.g.f. of Expo(A)] 

M(t:Z)- p.(1-0)! «q.(01- t/Ay! =p A-AA- (А – 0). A) 
(а) M(r:Y) = M(t: pX + 2) = M(pt: X). M(t:Z) 

We - „М А= pt _1-р!/% _ ШЫМ , Р 


We Же that M(pt : X) = int pX) and if X ~ expo (A) then pX ~ expo (A/p). Thus, if 
is changed to А/р, the Denominator equals Numerator in (2). It follows that since X 
and Y are identically distributed; X ~ expo (A). 


ds 
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(b) Cov (X, Y) = Соу (X, pX + Z) = pCov (X, Х) + Соу (X, Z) = P 
=o, as X &Y are i.d.] 


px +E(Z). [Ind (X, Z)] 


[Ind (X, Z)] 


c; +0. 


Corr 0,004 = Суу {бубу = pox Іс} = р, [Oy 
(c) EY 1X = x) -E((pX + 2)1Х = х} = рЕ(Х1х) + E(Z | x) = 
Since М; (1) = (4/А) (1- t/ A) 2, E(Z) = M0) 2 4/ А 
E(Y 1X = x)= px + (q/X). [Regression of Y on X is linear] 
8-23. The n-variate Normal Distribution 
Let (Х|, X,, ..., X,) be an n-variate vector defined on the sa 


n-dimensional random vector and X be an n-dim vector, 
matrices, i.e. column vectors : 


mple space $. Let X be an 
both expressed as n x | 


X (Xi XX Я x [x хәл» Md [T = transpose] 


The n-variate vector (Х|, X,, ..., X,) is called an n-variate Normal random vector, if its 
joint p.d.f. is given by 


Ix (x) = exp|-2 - m)" (K")(x-p)] 


1 
(/2т)” (det K)? 
where p = (ц, Hy, ..., p) is the vector mean [ы = E(X)] and К is the covariance matrix 
[c;], с, = Cov (X; X) and det К = determinant of the matrix K. We understand the 
notation : 


fx &) = fx, x, Q0 X4) 
Alternate Approach : 
Let 2; ~ N(0,1), 1x j Sn be indep. variates. If, for some constant p, and aj 1 <і< т, 
X,sp а ариз ае ЧЕЛ ОМО 
then the r.v.s. X,, X5, ..., X,, are said to possess multivariate normal distribution. 


Since the linear combination of indep. normal variates is a normal variate, it follows 
that each X, is a normal variate. Further, 


£ : EL 
E(X,) = p; var (X;) = Var (p, + аг Уа. [Var Z) i EZ) ape 
Since Cov. (Z,,Z,)=E(Z,Z,)=Lifr=s; E(Z,Z,)=0, ifr +s. So Cov (Z,,Z )- 8... 


: n n » n n 
Cov (Х,, X;) = Cov C +),а,2,, uv Zaz, | = Cov » 42 | 
M p? ms 
sal 


3 m 
rz] 
ra] 


xz0 x=0 rz] 


To determine the joint distribution of Х|, ..., X,, we find their joint m.g.f.. Now 
Y «tX, +1,Х, +...+1,Х,„ =O (Hy + Ха 2) + (py + Уа, 2) * t. (Jt, + Xa, Z,) 


mJ) 
= Lug (Zt;a4,)Z, + (Et aa) Za tan t (Zhe, )Z,,.. Isizm, 
We use prime ' to indicate transposition. 
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Obviously, E(Y) = E(21,Xx,) = Lt, = tu (row vector x column vector) 
Var (Y) = Var (21,X,) = Var [У Hiti + (Etja,)Z, +... + (Lta,,) Z,] 


ni i^^ in 


n m 2 n m m m m n 
2 2.1 а, | = 7, (Era, I 2,1, a, |= ELO Р As | 
pe Vx k=l s=] 


s=] Vizl і=1 k=] 


і 
t1 
с %, 


Oo; = (О, pe. [by (1)] [(9;;) is m x m matrix] 
Recall : Y ~ Мр, 0°), then E(e”) = e+", [r= 1 in mg.f. of N(p, 0^] 


M(t, ..., tm) = E[exp (t, X, +...+1,,X,,)]=E(e”) = ШЕ TEES) Yo Д 


2i 1 k=! 
| ‹ ыш 
= exp іі are, 


where г = (t,, ..., 1), prime indicates transpose and (6;) is dispersion (covariance) matrix. 


Note. f(x) -(Qn)" 1o; 1) ^ exp[-1(x- Wio" (x -j)'], 79 < x; <, 15i & m. 
This shows that the joint distribution of (X,, ..., X,) is completely determined from the 
knowledge of р, апі с; i, k = 1, 2, ..., т 
Cor. For bivariate normal 

M(t,, t,) = exp [(pyt, + boty) + Loiti + 2po,6, ft, 1 0217 )]. [o,, = 0,9050] 
Chapter 20 is devoted to the study of bivariate normal distribution. 
Example : Let X = (X,, X,,..., X,) be n-variate Normal vector. Show that if с, = Cov 
(X; , X) = 0, Vi, j (i +j), then X,, X, ..., X, are independent. 
Solution. Given 6; SOILE j, 0; -g? (i=j) the covariance matrix К and its inverse 
are immediate 
n 0.0 ix 0c.0 
ED] al Ge 01. det x 02 03,...07 
we XS 
(x — 1) (x, — ys X) — Hs X T Ha) and thus 


(х-н) TUK!) (x- Ш) = КЕ = [x qt = row vector] 


2 
Uu | 1 „К (=H) | 
2 = a, эр| 22. 9 


fous, F(X yp Xy e Xp) = fix) 0) f, 05) muU 
Where fo) = (Отс, e -(x, ш/о? etl. 


ч Equation (1) implies that X,, X», ..., X, are independent he variates. 
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8-30. Descending Factorial vig леа: oy W(t : X) and is defined by the relation 
The factorial m.g.f. of a random variable А 1: х (1) 

wer: X) = EIC + 9 b. 
: .—r4 ]) we can rewrite (1) as 
Since (14.0 ух Өг Jr where x 2x(x- 0 (7 2 € r1) 
d : ' r ! 
Wi: X) = EXO 17 1 ЕХ]! rh = Ён)! E 


i nq. 
= E[X?] is the rth-order simple factorial moment. Eq 


£^ 


a) 
(2) explains why 


where yj, | 
result (1) is given the name of factorial m.g.f. 


We combine (1) and (2) 


Alternate. Sometimes, we define descending factorial m.g.f. via Gy(t) = E(t’). 
Mere; G'(r) -E(Xr*-*), GYO = EXP), on Gg) EXOT) 
Putting г = 1, we get 

Gy (1) = шь =EX®), k= 1,2,3,... 


Remark. Sometimes, the simple moments E(X’) can be most beautifully determined from 
the factorial simple moments E[X?]. As such, the function W(t : X) is of sufficient interest. 


8-31. Factorial moments via factorial m.g.f. for some Discrete Distributions 
1. Binomial distribution. X ~ bin (n, p) 


wt: Х) = Е(1+ 0* = pi ч 4 "UPA +t)" = [4+ pA +t)" = (1+ рг)" mth) 
Using (1) W@:X)= Xu PME à (o) =n pl 
sing ADS Но 2 (ptr) => p, 2n" p. 2.0) 


Thus py = Е(Х) = np, шь =EX(X - 1) = тщп – Dp! > E(x?) = np? + пра. Var (X) = npq. ...(3) 
2. Poisson distribution. X ~ Pois (А) | 


о oa, x 
W(:X)-Ed 40-2 Yf— gape tS ГАИ р _ 
( ) ( ) p> br (+t) e D NT RE Г A QM 1) — (1) 
Using (D, W(t:X)e Fw La y AN 
sing ( ), W(t:X) D "T 2, ад, + 42) 


Thus, ui =E(X)=A, n =ELX(X - 1] = 2 


=> E(X’)= 2, 
3. N-B distribution. X ~ NB(k ; p). OO) AX; Var D А B 


i-o BIO EMEN UE н 
А х | 4' («0 = ратар 
- ег {тай 


р к) 
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Using (1), W(t: X) = Eu, 5-7 Z(**-'Y (8) DON i-r yo (£ TR 
r=0 *  r=0 Q p p 
So kl P. M = (k + DK (q/ р)? => E(X?) = et m ЖАМЫ acd L4 
p “р p 


8-32. Linear Combination Property 
If X and Y are two independent variates and a, b, c any constant, then 


W(t:aX + bY + c) = (1+ 1) W(t: aX) Wit: bY). 
Proof. W(t : aX + БҮ + c) SE((14 0 *"** Е. (10). (120^) [by Def] 


= (1204.02 0^ L0 0" = (1+ 0€ W(t: aX). W(t: bY). [by Lin E, indep. & Def.] 


8-33. Relation between Simple and Central Factorial Moments 
The factorial m.g.f. about X = O and X = р are connected by 


oe e 


Yn “feces =p)? ti Yu == у Q) = 
Ho) v 7 j! His - Mc Ш) His) [s=r—y] 


Comparing the coefficient it t'Ir ! on е sides, we get 


i, = PETAT HR E (р)? у = 3A (z) uL; Cp. 
In uui taking r = 2, 3, 4 we obtain 
Hoy = My Н + o [u'(1) = н] 
Ha = Шз) — Зу н + 2p? - 2p. 
Шау = B) 7 4B H+ бо) HCH D) - Зр(и? + 29^ - р - 2). 


Exercise 8(a) 
1. Can M(t) = exp (2/2) be the m.g.f. of some random variable ? [No] 
2. If w =3",r=0, 1, 2,..., obtain the p.m.f. of X. [P(X = 3) = 1] 
3. Obtain the m.g.f. of the random variable for which 
() yi! =r! r=0,1,2,... (ii) pl =(r+1)12", r=0,1,2,... [Ans(1-0 (1-20 7] 
4. Show that if X. is the mean of л i.i.d. variates each distributed as X, then 
M(t: X,) - (M(t/ n: X)]". 


5. The variate X has the Laplace law : f(x) = 5 1g" exp (Ix — 0/0), —oo < x < o. 
n x/2 


Find the m.g.f. of X and hence show that E(X) = Ө and Var (X) = 20°. Also obtain E(X"e""). 


6. A variate X has p.d.f. : fx) = iy _x=1,2,3,... Find its m.g.f. and variance. Show also 


E(X") = УК" /2*), 1€ К< о. 


thods) | 

: ransform Me E 

Generating Functions (or T m a»0, b» O. Find the m.g.f. of X and 
tee” 


7. A variate X has p.d.f. : f(x) = ab". x= 0, 1,2,3, -. he first two simple moments. 
deduce that т, = m,(1 + 2m,), where 1, т, are T 

8. Obtain the m.g.f. of the variate X having p.d.f. 
Кх) = х,0<х< 1; х) =2-х,1 <х<2; х) = 0, els 
Show that р, = 1/6, p, = 0 and p, = 1/15. 

9. A variate X has the p.d.f. given by 
(a) Дх) = 1/3, -1«x «2; fx) =й; elsewhere. 


(b) fix) = 1/2 x, 0 < x « 1; f(x) = 0 elsewhere. 


Find the m.g.f. and hence the mean and variance. 


ewhere. 


3 | 4 
cite ee = — Var (X) = — 
E 0) M()- 5, VES? men 3 ar (X) 45 
10. Let X be a mixed variate such that 
fix) =c,0<x<1,0<c< 1; f(x) =0elsewhere. 


P(x) = (87 1) p'a- р)" (1-с), x=0, 1, 2,... (у an integer) 


r-i 
Show that M(t)  c(e! — Dr^ +(1-c)[p/(1-qe')]", and find the mean and the variance. 
11. Let X be a mixed variate such that fora > 0, А> 0,0«K« 1; 


f(x) = Кх е IT (a), 0 < x < ©, omitting the intergers 1, 2,3, ..., f(x) = 0, otherwise. 
Р(х) = (1— ®) (”) р^ (1 p)"~*, x =0,1,2,...,.n,0<p<1. 


Show that M(t)=k(1—1/A)“ +(1—k) (9 + ре')" and tind the mean and variance. 

12. For the p.m.f. : P(X = х) = a,8'/f(0), 0 < x < »o, Ө > 0 where a, > 0 and f(0) = E a Ө". Show that 
M(t) = {Өе ДӨ). | xd, 

13. The m.g.f.’s of variates X and Y are expressed as power series : 

oo o or к=к 
Me: X)= Er, leti MG Б у Он 
r=0 r=0k=0 KN“ 2 
(a) Find E(X”) and E(¥*),n =0, 1, 2, ... (b) How are the variates X and Y related ? 

14. Independent variates X and Y have the p.m.f. : i 
P(=x) = x/6, х= 1,2,3, ; Р(Ү=у) = (у+2)/10, y=~1, 23, 
Using m.g.f.’s, find the distributions of S= X + Yand D= x_ Y 
[Ans. f(0) = р, 1) = 2p, f(2) = 3p, f) = 4p, f(4) = 13р, 5) = 


g(-2) = 5p, g(-1) = 14р, (0) = 23р, g(1) = 12р, g(2) =p, 22p, f(6) = 15р, p = 1/60. 


8(3) = 2p, 9(4) = 3p] 
15. If the joint m.g.f. of (X, Y) is (i) M(t, t,) = exp Hg; +r 
what is the distribution of Y ? 
16. Continuous variates X and Y are jointly distributed as 
fx, y) e*,0 « x « y « »; fix, y)=0, elsewhere, 
Show that the M(t, t5) = [(10 — £5) (1— t 


)], (ii) M(t, ,) = exp [(t, + 1,)/2], 


– 2)! and 
1 2)] hence prove that X and Y are not independent. 
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17. Let X, Y. Z have the joint p.m.t 
: Bu <" 
fix, у. 2) = ao UY г) 6 [(1, 0, 0), (0, 1,0), (0, 0, Dy. (1 l UR fin 3 j= 0, elsewhere. I sing m. g.1 
show that X, Y, Z are pairwise indep. but not mutually independent 
18. Define the m.g.f. of Y X = x. Does M(t:Y)  E|[M(t:Y IX =. |? 
49. A variate X is known to have the distribution : dF = КІ (x/a)|!" 'e "dy -а< х a 


Find the constant k and determine the linear relation between D, and B, of this distribution 


Also prove that M(t) = e™ [1 — (at/ ту”. 


8-40. Cumulant Generating Function 
The cumulant generating function (notation : c.g.f.) of a random variable X, denoted 
by K(r : X) or Кү(ї), is defined by the relation. 


K(t: X) = log M(t: X) = log Eu’ (t/r), 0€ x «oo 24 81 


provided the resulting series on the right side in (1) is convergent. If the Taylor's 
series for K(t) be 

K(t) = К+ kt? /2!+ ka 131... dij 
then the coefficient k, is called the rth cumulant of random variable X; r = 1, 2, ... 


If we differentiate (2) w.r.t. ‘t we readily obtain 


IX KO. = КОО) =k. (D = dldt) ...(3) 


8-41. Effect of Linear Transformations on K(t : X) 
Since M(t:a-4 bX) 2 e" M(bt: X), taking its logarith yields 
= (n M(t:a+ bX) = at + in M(bt: X) 
X Гг) = аг + XkXbty /rl, (гл 1,2,3, ...) 
Comparing coefficients of / on both sides we obtain 
kj =а+ bk; К, =b'k,,(r22). 
Thus, all cumulants except k, are unaltered by the change of origin (factor a) and rth 


cumulant of Y = (a + bX) is b’ times the rth cumulant of X. Thus, a linear map possesses 
Semi-invariant property. Eq. (1) governs the effect of change of origin and scale on Kin. 


8-42. Cumulants in terms of Central Moments 
Since M(t : X — u) = e™ M(t : X), taking its logarithm yields 
(n M(t: X) = M(t: X — p) + ш. 


Inserting power series for m.g.f. and K(t), we get 


— = prin {i+ En i] [н = 0] 
rm] Fa 


2 г 3 а г< 
SFR EIN, а е г -H n Win 
we fu, Is £] бу adh 


(1) 
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first. !), are obtainable : 


^а = 10p; + 30,1; | 


e imo Р NEL r 
The first few relations, using k, = Coeff. of (t/r 
= 10.» ks = Ho 


ki = H, k, = z, k, =, ky = My -3uj, ks = Hs 


8-43. Simple Moments in Terms of Cumulants уу = оК). Inserting power 
We invert the definition : K(r) = log M(t : X) to obtain M(t : X) = 
series expansion of M(t) and K(f), this gives 


2 r 3 
E ' "u м © i t t 1 T. ч. Ук а “о БҮТ) 
Èu eo [ £x C] i (m 5) (0 5) Д л 


r=0 r: 
The first few relations, obtained by comparing coeff. of t/r |, are 
2 4 
Hi = ky, ра Ky + KÈ, щ = +З + s py = hy + GG + Ag) + Oke Ь +. 


8-44. General Linear Property 


k,(aX + bY) - ak. (X) + b'k, (Y) EM 
where X and Y are independent; a, b are constants. 
Proof. M(t : aX + bY) = M(at : X) M(bt : Y) (^ X, Y are indep.) 
(п M(t:aX - bY) = M(at: X) -ün M(bt:Y) 
... (1) 


or K(t:aX * bY)- K(at: X) + K(bt:Y). 
We now equate the Coeff. of t/r ! on both sides of (i) and Eq. (1) emerges readily. 
Extension. If X,, X,, ..., X, are independent variates, then 
k (tia X, + ..+4,X,) = aj K (Xo) Pd REO). A 2) 
The proof follows by mathematical induction. 
Cor. If. X =(X,+X,+...+X,)/n, then putting a; = 1/n in (2), we get 
k (X) =n [k OX) + k, (Xp) + +k, (X,)) RED 
= (1/n) ^! (Xj) [if X, аге i.i.d.] (4) 


8-45. Excessive-Kurtosis Theorem 

The excess of kurtosis of Sampling distributions of mean X is (Мп) times the excess 
of kurtosis of the given population. 21 
Proof. If y, denotes the excess of kurtosis then by 8-44(4), 


‚фу BOO T MED P CD 


1 
7a. 
Excess of kurtosis of X =(1/n) [Excess of kurtosis of population X] 


8-46. Worked-out Problems 
Esdapl 1. If u, - E(X") and К, is the jth cumulant show that 
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Solution. Insert power series expansions of M(t) par K(t) in ihe 'defigition 
in M(t: X) = K(t: X). 


20 y^ oc i 
n=0 п. j=l | Ji "mid 
ssume that th series i 
We ass at the power series invovled are uniformly convergent, so that term by 
term differentiation is permissible. Differentiating (1) 


© п | z x " RA 
>, t [А du ' 2 й г! 
Р (n- 1*7 5 Тш, p А (j-1)! 


We now clear the fraction, replace the dummy n by r (only on the L.H.S.) and obtain 


^ Py К 5 kit?” E PA o 
E жаз ZEB (n- 1)! 


tom К, uae 5-2 c o ec nil yo! 


Bout Gilad! is ца 0)! 


We now equate the coefficients of г '(r — 1) ! on both sides [use n = r — j + 1] to get 
plo (Е) К Alr] ; 
di PAE ТЛ DE E d 
оё 2. Prove or disprove : M(t: X + У) = M(t: X) M(t:Y) < (X,Y) are independent. 
Solution. Consider the joint distribution of X and Y as shown in adjoining table [p= 1/9]. 
Since #2, 1) =2p #f,(2) f = 9р", . 
we conclude that X and Y are not independent. Also 
M, (t) =E(e*) 2 3p(1 e' € e") = Му(0). 

Let Z = X + Y, and write p, = P(Z = r). Then 

Po = P. ру = 2p. Р = Зр, Ps = 2р, P4 = Р. 
Observe the formation, e.g. p = P(Z = 2) = 
P{(0, 2) Ы (1, ) 9 2,0) = 2p +p + 0 = 3р. 
М. (1) = р(1 + 2е' +3e” + 2e" +е“)= plc e' +e") 
Thus M(t: X + Y = M(t: X) Ма: Y), although X and Y are not independent. 


Example 3. Let K(t,,t,) = M(t, 0). Show that 


Ja=r-j+D 


2 
an, =Е(Х), ES em, ar * ar; Ot Ot, 


-pth =). 5 1 + Hola) 
Solution. We apply logarithm to central m.g.f. : та.) =e ta) ara тын t Мт). 


M(t,,t,) = exp (ut, + ot) m, to) > KG 5) 7 Hih + Hala n mt, t) 


? 
Р дт д-т 
We wri д _ om o; PEL Бес and note : 
EU ^7» у, Pe at а t; 
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-g2,m,4(0,0) 2 0, 
m, (0 0) = m, (0, 0) 0, m, (0, 0) = оу, m»; (0, 0) 07, m,,(0, 0) =; 


1 ~ M mMm, 
ôK m, OK _ m, QK _ mm,- my QK тт; – тт; 
ja m, OK m OK ттт a i 
Д ý 2 01, 01, т 
wen Or, Pi m т" 
с 


т Ot, m 
-gL.0,K(0,0 
0,K(0,0) = |, 0, K(0,0) = 1, 0,,K(0,0) = © xy, 0,K(0, 0) = ох, д„К‹ ), О) ) 


Problems with Solutions Provided at the End of the Text 


1*. For the Exponential distribution : dF = ye "^ dx, 0€ x ««,0 70 
find the interquartile range, р’, and k,. Show further that p, = 4 and p, = 9 


J, IfXisa variate with zero mean and cumulants k,, show that the first three comulant 
A, of Y= X? are given by 


Ay =, А, mk, +2K2, А, = he 25K] 6k k,) + 80. 


3*. Show that M(t : X 4 Y) = M(t: X) . M(t: Y) = X and Y are uncorrelated. 
4*. Let X,, X,, ..., X, be a random sample from a distribution with E | X^ | < о. Write 


u = E(X) and u, - E(X - р)“, X = (ZX ,)/ nand S? = X(X, — X)! /(n— 1). Prove : 


Z 
Var (5?) = EE 2а. Cov (X, 52) = m, 


-1 
Erercóe кы 


1. Write mx(t) = MP (9 M(t) K(t)= M(t) [Cumulant generating function] 
Show that mj (I) = m, ,,(t) — m,(t) m(t) 
Deduce relations for c.g.f. : 
K'(r) = my), К''@) = т (0) – [m (Op? 
K® (t) = m(t) - Зт (t) m, (6) + Am, (C? 
К) = m, (t) – 4m3 (t) m (t) - 3m2 (t) + 12m, (t) mi (t) - 6m? (t) 
2. Show that if E(X^) = (r + 1) 127, thenk, = (r- 1) ! 2) *. 
3. For the distribution f(x) = ce ^, х> 0), с> 0, show k, = (у — Hier, 


4. Show that k, = 1.3.5.. (2r - 3) u?-')!7". for the distribution 


x 1/2 x» - 2 
fe (2) oo] za x»0,1»0,n»0. 


ди! д 
5. Sh sa ad аё g , H, m" r 
ow that Bk ar aK, -(^)u..., gt, 2,8, Vier. (rz 2). 
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6. For the p.m.f. : P(X = x) = a,0'/f(0), 0 < x < © Ө > 0 where a, > 0, f(0) = Ха,0*, prove that 
П < T — 1 ' dk, LM y dk. oM a P 
Er ERNS =0— к = r-i ' AJ a r-i ' 3 
j=) J 1 y 4 1 dð r+l 92, } = 1 H, j dO 2 j-2 TUE 4r 
7. For the p.m.f. of Exercise (6), show that k(7) = 0"D' [logf(6)1. [D= d/d0] 
$. Define a factorial cummulant k,,, as the coefficient of t"/r ! in the expansion of the logarithm 


à (7) 
of the factorial т.р. Ё. Prove the following relations : 


ka = bys ko = – ky, Кау = ky -3k, + 2k, ku = k, — 6k, + Mk, — 6k,. 


9, Prove that H, = as Dun... 


jd — | 
10. Leta, = k/r !. Then show that 
à = 0 0 0 
2a, а, -2 0 see 0 
ra, e Da Daz: x d, 


8-50. Probability Generating Function 
The probability generating function (written p.g.f.) of an integer-valued variate X, 
written G(t : X) or Сү(ї), is defined by the relation 


G(t: X) -E(t*) = Х,Р(Х = x) i^ = E, р(х) г". e 
Note that the name p.g.f. is due to the fact that the coefficient of t“ in E(t*) P(X = x). 
Uniqueness theorem. Let X and Y have p.g.f.’s : Gy and Gy. Then 

Gy (t) = Су (0) Vt P(X-k)2 P(Y  )0sk«o. 


Proof. Since Ў TOR IS s p, =1, it follows that G;(f) exists for all values of ¢ satisfying 
k=0 k=0 . 


It| € 1. Hence Gy and Gy have radii of convergence at least 1 and therefore these have 
unique power series expansions about the origin 


Су) = Xi рь GO= Уа. [p, = P(X 0), а, = PY = Ю)] 
k=0 ES 
If Gy = Gy, then these power series have identical coefficients (p, = 4) and conversely, 


if p, =q, we get Gy = Gy. 

Note. Physical meaning of р-87. 
Let X be a non-negative integer valued variate with P(X = k) = P, Let г be a real 
Dumber, 0 <7 < 1, When X = K, perform & alternative trials each with aaa 


Success г. Let A denote an event of no failure. Then, by Multi-Stage Rule 


"ES - TN Wt mon 
Rida 23POC P(AVX k) Lh X 
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~ 
B 


Relation between the P.G.F. and M.G.F 
р" s X 
(i) M(t: X) Ete") (ii) G(t : X) = (e ) 


ba : I ^ р А »» 
Thus (i) is obtainable from (ii) by changing ¢ to e. Conversely, to obtain (ii) from (1), 
change е to t. So 


M(t:X)=G(e':X); | G(r: X)  M(Ün t: X) 
Thus : M(t: X) = (q + pe')", then G(t: X) = (д + рг)". 
Similarly G(r; X) = 79-78 => M(t: Х) = e" * -D etc. 


8-51. P.G.F.s of Some Standard Distributions 
The computations for m.g.f. [88-16] and p.g.f. are similar, instead of е’ we have to insert r. 


1. Binomial distribution : f(x) (") RS ык EOS eee G(t) = (4 + pt)’. 


2. Poisson distribution : f(x)- e? /x!, x=0,1,2... G(r) 2 e^». 

3. Geometric distributions : f(x) ГРУ гар 2... G(t) = p/(1— qt) Iqtl« I. 
4. Pascal geometric distribution : Рур & ET G(t) = pt / (1— qt). 

5. Neg-bin distribution : f(x)= (* i : i ) pio 09,52... G(t) = [p/ (1 - qt). 


6. Pascal N-B distribution : f= 3) pq ys k (k+l)... G()- [pt/ (1 - gD]'. 


7. Multinomial distribution : Е Га P's Gt = (pt... pt)". 


8-52. Effect of Linear Transformations on РС.Е 
G(t:a+ bX) « t" G(t^ : X). 
Proof. G(t:a-- bX) = Е) - Е“) Е) С? : X). 
8-53. Linear Property 
If X, Y are independent variates, then for constants a, b 
G(t:aX + bY) =G(t" : X) G(^ :Y) 
Proof. С -(t:aX + bY) - Ег“ +" ] =E% 1" ] 2 Efe ]Е ] 2 Ger: X) GO'Y) 
[^ X and Y are indep.] In particular, 
G(t.X--Y)aG(ti X)6(1:1Y). 
Generalization. If X, i = 1, 2, ..., n are independent variates, then 
G(t: X, + X, +... + X,) = G(t: X,) Git: X,)... Gt: X.) 
= [G(r: X,)]", if X,’s are iiid. 


The proof is immediate by mathematical induction. 
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g-54. Sums of Special Independent Random Variables 
Į. Let X ~ bin (m, p) and Y ~ bin (n, p) be independent. Then X + Y ~ bin (m n, p). 
2. Let X ~ Pois (A,) and Y ~ Pois (A,) be independent. Then (X + Y) ~ Pois (A, + à). 
3. Let X ~ NB(k,, p) and Y ~ NB(k,, p) be independent. Then (X + Y) ~ NB(k, + ks, p). 
4. Let X - gem (p) and Y - gem (p) be independent. Then (X Y) - NB(2. p) 
Proof. In each case we use G(r : X + Y) = G(t : X) . G(t : X) and appeal to uniqueness 
theorem. 


I. G(r: X) = (q + pr)" ,G(r:Y) = (д + рг)", G(t: X).G(r:Y)2 (9 + pr)" t" G(t: X +Y) 
Thus(X + Y) ~ bin (m +n, p). 


2. Gt: X) s e^" D, G(r Y) 2 e". GG: Y) (y) =e)" 2 Gg: X ууу 
Thus (X + Y) - Pois (A, + à.) 


3. G(t : X) - [p/ (1 — qD]^ ,G( : Y) = [p/ (1 - gt)", Gt: X) .G(r Y) - lp/ (0. — qp]^ * ^ =G(t:X +Y) 
Thus (X + Y) ~ NB(k, + Ras p). 


4. G(t: X) - p/(1— qt), G(t: Y) = p/ (1- qt), Git: X).G(t:Y) = [p/ (1 - qt) 2 G(t : X +Y). 
Thus (X + Y) ~ NB(2, p). 


8-55. Moments via PG.F. 
Let X be an integer-valued random variable with a p.g.f. G(r). Then 


(a) С) = 1, (b) ц, = EX] G' (1), (с) E(X) = Gj, (d) Var (X) = С”) + G'() - [Ср 
Proof. (а) By definition : G(r) -E(r*) so that G(1) -E(1) =Е(1) - 1. 


ED EGE Dr pix). (0) 


We assume that the series in (i) is uniformly convergent, so that term by term 
differentiation is valid. Differentiating Eq. (i) r times w.r.t. “г? we get 


G'(t)= Yu =Nh(e—2) rene" px) 


х=г 


Where G'(r) = d'G(r)/dt’. Putting г = 1, this gives 
Со) = у х(х-1)(х—2)...(х-г +1) р(х) -E[X?] 2 i, Wi 


(e) In particular, putting r = 1 in (ii), we get С'(1)= н, = E(X) (11) 
(c) Letting r — 2 in (ii), we get G^ (г) = E[X(X - D] = uj, 

© GM) =Е(Х?)-Е(Х) = EQ) 2 С") « G'QD. [by (111)] 
P Var (X) = E(X?) -E (X) =G" (1) + G'() -G'(D]. 


е} 
- 


nctions (or T ransform Methods) 


Example : The Dirichlet’s p.g.f. has the form 
G(n-X(p,/n) nal (G(0)= Xp, = 1) 1 

кп , " 

If X is a r.v. with P(X = n) = р, find Var(X) and E (in X) 


Solution. Put t = -1 in (1) to get G(-1) = Zn.p, =E). 


Put г = -2 in (1) to get G(-2) = En? p, -E(X^) 
Thus Var (X) = E(X?) - E (X) = G(-2) - [GC- DT 


Now differentiate (1) w.r.to ‘? to get 
- =| 
С = Xp, £ y = Ep, (n^) (n (^!) 


Put г = 0, to get 
G'(0) = Ep, (-1) în n = (-1) Хр, пл = (—1)!Е (n X)] 
Thus E(Un X) = —G'(0). 


8-56. Probability Mass Function via p.g.f. 
There is a unique one-to-one relation between the p.m.f. of a non-negative integer 
valued r.v. and its p.g.f. 


Proof. Since С(г) = Xp ",0€k«oo, is convergent for all | t | € 1, term by term 
differentiation of the power series G(t) is valid. Hence, for | г | < h 


G'(t) = Dk pet" SM) = TRU GM = TKO D = ke =I). (re DI) 
k=] k=! 


k=n 
Substituting 7-0, these give GUN (05) =n! p.. 
e (9) 3 


n=0 n! 


It follows that the p.m.f. uniquely determines its p.g.f. and conversely the p.m.f. can 
be uniquely recovered from its p.g.f. This justifies the name to G(t) as p.g.f. 


8-57. Product of Two Generating Functions 
С100) -Ga (P) = Gp) G4, ) = (Po + рї + ри? +...) (gy + qua Bax 


= родо + (Pod + Pigo) t + (Dod + Pidi + Paqo) t? +... + (Podni + Pin) +... + рф)! + 
If we write G(t) = G,(t) . G,(t) and let G(t) = Lr, t^, it follows that 

Tn = Podn + Р\Чл-1 + P2Qn-2 + +--+ Dd;  Ypq, , O<i<n, (1) 
Whenever a sequence uu is obtained from two sequences (p.) and (g,) by means of 
Eq. (1), we say that (r,) is a convolution of (p,) and (q,), bien У = p : q-4"F 
Conversely, r2 p* 4 > G(t) = G (б G,(t), 
Соғ. 1. Let X and Y be indep. integer-valued variates with probabilities (p,) and (4, and 
let Z = X + Y. Then {Z = n] = ((0, n) Ы (1, n — 6 (02,һ-2) 9... Н (0). 
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P(Z =7) 3 Pod, T Pi 4, - 1 ect Po ES Урд, p" 
Thus r =p * 4, so that G(t : Z) = G(t : X) Git: Y). 
Сог. 2. The generating function of P(X < n) is H(t) = GOIA ~ t). [n 2 0] 


Proof. Let h, ood ddl MODI WIE Shea bP; FL + Pst wh р, 


Thus, h = 1 * p and H(t) = (1 - 1)" Gt) = G(t)/(1 — t) becuase the generating function 
for the sequence <I> is 1/(1 — ^). 


ЕЕ )e1.1-1.241.02 81.0 0-192472 .-0-27] 
8-58. Convolution (Statistical Sum) Formula 
Let X and Y be independent integer-valued variates and Z = X Y. Suppose 
P(X =k)=p,, PU = j)=4;, P(Z-k)o n. ј,К=0,1,2,3,... 
EEUU Y = у= EPX =i) PY =k -i), or һ = Ўра, Osi«k. 
Proof. Here G(t: X - Y) 2 G(t: X). G(t: Y) Ert = (Zp,t') (Zq ti) > Xr, t* = ХУра і 
Comparing the coefficient of i" on both sides (i + j = k) yields 


О te. P(X +¥ =k) = 2P(X =) PY =k -i). 


8-60. Some Tail-ends Generating Functions 
To Find the generating functions of : 
(a) P(X > n), (b) P(X 2 n), (c) P(X « n), PC ny Ce} PO = 2n): 


Proof. Recall : G(t)=p,t",n=0,1,2,3,... [p, = Р(Х = п)] 
(a) P(X>n)—P(X>n+D=P(X=nt)) 9f - fuam ра 1, = Р(Х> n) 
meer теат ттр, 


EE Era иер. Рино = Ўл NT 


n=0 É n=0 n=0 
Now, E OP Te а H(t) – fo; È Prs "mz Ури" — Po = C(t) – Po 
n=0 n=0 vi n= 


Further, f, = P(X >0)=1- P(X 20)-1- р. Making substitutions into (i) we get 
HO - ^! [H() - (1 - p] 2 € [G() - ро] > H(t) = 1- G(]/ (1—1) (а) 
Formula (a) gives the generating function H(t) of the tail probabilities. 
(b) P(X >n)= P(X =n) + P(X >n), і.е. 8, = Рр, + | Ж [with obvious notation] 
Ig, t" = Ep t" + Ifa" (n=, 1, 2, ...) 
or H,(t)=G(t)+H() = GA) * 1-7 G00/U - t], = 11 (6(0] 1(1- 0): 
(c) From relation : P(X <n + 1) - Р(Х < п) = Р(Х = п), we get 
фал =ф, = Par [b = РХ <n] (п = 0, 1, 2, 3, .., ©) 


[by (a)] _ ..-(b) 
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PUE Gna) Оф) = Gi" p) 2171190) = 99] 7 ACO) 
As фо = P(X <0) = 0, the above result reads 
H0) -:1G()/(»0—7) — [Hy() = ХР(Х <n)t"] 
Aliter. P(X « n) + P(X = n) + P(X»n)-1 yields 
0" P(X « n) + Xt" p, + Xi" P(X >п) = Et", 
A(t) +G(t)+ H(r) = (1-0), => H,(0-1:6(0/( - 0. 
(d) Xi" P(X < n) = Уу" – P(X > n)] = E^ - Xr" P(X >п) 


1 1-60) 50 
T Lee Up ae 
(e) Let P(X = in) = Po,» then 


HADE Ур," = Xp, (Jt)" = Xp, s". (s=Vt),n=0,1, 2... 


[0 € n < om] 


[by (a)] 


= "tie + p (-s)"]= 5IGG) + GC) = 4 [G (Vt) + GC] 
гш 


90, Sv" РОК) ew, SPX <п)= Zo, St" P(X <n) = 


Lt" P(X >п) = 


8-61. Worked-out Problems 
Example 1. Find the p.g.f. and m.g.f. of the distribution fœ)=+4 
t3 en 0 4n aed, p+ gE: 

Solution. Са) = Er )-YXlpq"'". 


m x, +2, 
D 


= 1(p/qg dt" .q" 
(p! 24) q(t +27") +40? +272) eq 1) +} 
= (p/24) (Z(qt + X(q/t), 1<п<о 


гур jat, еи 
- 2118 г Qi} Iqt|« l,Igl« t. 


- Er Aper]. q«Itl«l/q 


l-gt £—9 


мо Ji ) in q «t « - ln q. 
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Example 2. Show that (a) G(r) = 2/(1 + г) is not a p.g.f. 

(b) If G(r) is a p.g.f., is [2 — G(r)] 'ap.g.f. ? 

Solution. We зди that if G(r) = Po + pit + Dot +... IS a power series that converges when 
| 11 € 1, then С(ї) is a p.g.f. iff p, > 0 for all r and G(1) = 1. Here 


(a) Here G(t) = 2(1 + mn = 22 (у = Porą <9. 


Since some coefficients аге negative, G(t) is not a p.g.f. 


(b) A(t) = il-icop'- У (1) (ay. 


Now, coefficient of г" in each of G(t), [С(т)]?, [CO] wis non-negative because these 
are each p.g.f.’s. If we express (1) as a polynomial in г, then 
H(t) 2 po * pit * p, P Ju 
each p, 2 0 and py + p, + p; +... = [2 - GO) = (2 — 1) = 1. Thus, Н(т) is indeed a p.g.f. 
Example 3. If G(t) is the p.g.f. of a г.у. X such that P(X = n) = p,, obtain the p.g.f. of 
P(X = 2n). If С, and С, are p.g.f.’s then G(t) = С, [G, (1)] is also a p.g.f. 
Solution. Since G, and G, are p.g.f.’s we have 
G(t) = С, [С, (t)]= po + р, GO + р, IG COT. +... + PIG, OY +... (1) 
С(1) = p, + p,G,(1) + p,EG, (DT +...= p + p, + р, +... = ЦС, (D = 1, as С, is p.g.f.] 
We rewrite (1) as 
б = pot p, [Pt Bt Р, +..]+р, [P + Bt Ри" +...) +... 


This shows that each coefficient of г is non-negative. Since the power series (1) 
converges when | t | € 1, G(1) = 1, and coefficient of t' for all r, are non-negative, we 
conclude that G(t) is indeed a p.g.f. 

Example 4. Let {X,} be mutually independent variates each assuming the values 0.1.2, 
4 — 1 with probabilities 1/a. If S, = X, + X, +... + X,, show that the p.g.f. of 5, is 


Gaye e - tar. 


; L x 2 -n k jak 
Deduce : P(S =j) = — | Aly Jc» M 
( n D а" 2 k j -ak 


k=0 

| eee iie Mem 
Solution. Here, G(t : X) = E(r’’)= D (1)! alzi 
Since X, are i.i.d. variates, we get 


Gt: $) = (Gq: Xy =[0- 0)/a0 - 0 20-0" 070 а" 


E £)e-z££QU)ev t 20 


n 
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Now p(S, = j) = Coeff. of f in О(г: S,) ; hence putting 7 + ak = j in (1) we get this Coeff. as 


] n n —п k+ j-ak VP EA) 
PR, «Die ale Jon 
n J) а" D k j-ak 
Since (-1) 7^ =1 = (- ре (20); also (")=0,, if >п; So (2) yields 
. 1 ous -n "TU TY 
у T LT | X E | 
"=) а" 2, k JV j—ak co 


common distribution given 


Example 5. Let {X,} be a sequence of independent variates with a і 
a variate independent 


by a generating function F(t) and let Sy =X, + X, +... + Ху. If N is itself 
of X, and has a p.g.f. G(t), show that p.g.f. of Sy is given by GF(t). Hence, show that 


E(S,) = E(N)E(X); Var =(Sy)=E(N) Var (X) + E (X) Var (N). 
Solution. Since X, are i.i.d. variates, we have 
gt:$, = g(t:X, +... + X) -[g(r: X) ] 2 LF(OT =(0)". [6 = FO) 
“g(t: Sy) - E(") = E(E(C / N)) - E(0^). [p.g.f. of М] [by Double E-Rule] 
By hypothesis, G(t) = E(r’), it follows from above that 


g(t: Sy) = G(0) = G(F(t)) = H(t), say 
H(1) = С(Е(1)) = С(1) = 1. ТЕО) = E@)) 


H'(t) = G'(F).F'(t), H"(t) 2 G"(F) .LF'(0] + G'CF).F"(t). 
E(S,) = Н) 2G'(D.F'(0) = E(P). E(X) 
As, H"() = С") ТЕС) *G'() FP") =E[M(N - D] py + py .E[X(X — 0] 
Var (Sy) = H"(1) + Н") СН")? 
= ([Е(№) - nli + EGO) - ndi + By ру 2р2 
= [EQN?) - Hy] x € (ЕХ?) ш], = 0% hy +02 p2. 
The mean and variance of Sy is also obtained in Wald’s thoerem § 5-54. 
Note. M(t: S,) = [M(t:X)]" since X; аге i.i.d. 


M(t: Sy) = E(e^") = Е[Е(е°" | N)]=E[M,(1)]" E(9^) = G(0 : №). 
Example 6. A hen lays X eggs where X is Pois (A). Let Y be the number of eggs which 
hatch independentily with probability p and Z be the those which donot hatch. (no 
chicks). Show that Y and Z are independent. Further show Corr (X, Y) = JP. 
Solution. When conditioned X = л, then Y | X is bin (л, p) so that 
G(:YVX) =(q * рд" — [p.gf. of bin (n, p)] (i) 
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Now v we Consider joint p.g.f. of Y and Z : 


X -Y 


E(t} 42) T E(t; 2 ) EDT ЖЕҢҮҮ. | [Let ¢,/t, = 0] 


E(E(r? .6"1X = х)}, [by Double-E Rule] 


s7 E{r; .E(0 1X = x)} [Y | x ~ bin (n, p) and pullout property] 
= Eft (q+ p0)*}=E{(qt, + pt,)*}, [ty = qt, + pty] 
= E()-e"^^? [Хх Pois (4)] 


Ap(ty-1) м -1) 


= gMdh*p)-Xps4) = e 


€ 
This shows that Y ~ pois (Ap) and Z - Pois (Aq) are indep. 
Thus E(Y) = Ap- Var(Y) Now 
E(XY) = E{E(XY1X =x)}=E{X E('Ix)), [YIX ~ bin (n, p)l 
= E{X . pX} = pE(X^] = p(Var (X) + E(X)) 
= p(À4 A) 
Cov (X, Y) = E(XY) - EX)E(Y) = Ap + Ap) — A(Ap) = Ap 


Con (X, T) a = Jp. 


Problems with Solutions Provided at the End of the Text 
1*, Let X ~ Expo (A) and Y be a discrete г.у. defined through X by 
PY = 1(2л + Dh) = P(nh € X <(n+ Dh}, h»0, n=0,1,2,3,... 


Find p.g.f. of Y and deduce that E(Y) » E(X) but Var (Y) < Var (X). 


2*, Lottery tickets bear numbers from 000000 to 999999. Find the chance that a ticket 
bears a number whose sum of the first three digits equals the sum of the last three 
digits. 

3*. A die is thrown n times. Let 5 be the total number of points. Show that 


P($ = n + 5) ME P(S=n+4)= mE). 


4*. po is a complete set of values (events) xy, xj, =» X, ... With probabilities po, Pi» 
» Py ... Which vary with time. These are related by the differential equation 


dp,dt = AG) = Pr) "m. 
Find the value of p,. 


Methods) 
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2*. A variate X assumes the values Xj, X», = with probabilities Pp Рә» --- Show that 


Р, (Kk) У, pje Wey [x, > 0, Ўр; = 1] 1} 


is a probability йын, of some variate Y. Find its p.g.f. and prove that 


E(Y) = E(X) and Var (Y) = E(X) + Var (X). 
6*. Let X ~ geom (p) and Y ~ geom (p) be independently distributed. Find the p.m. 
of Z- X + Y. 


ip Bivariate Probability Generating Function 
da X and Y be non-negative integer-valued variates. The joint p.g.f. of X and Y is a 
unction Gy yof two variables г, t, defined by 


Gy y (t, t,) = E= Pun. Lad t) 


T 
he probabilities f(x, y) = P(X = x, y- y) may be generated by expanding G as a power 
series in (t,, t) and reading the coefficients. 


The marginal p.g.f. of X and that of Y are obtained at once from (1) 


Су vt, D = ЕССЕ Есе 12) 
Moments. Assuming term by term differentiation of the power series (1), which is 
equivalent to interchange of differentiation operator and expectation operator E we - 


| Л 
р у= 
(2,2) Of, ТОЁ 


Olti) =E (XOY ad] 


Gen (1, 1) E[X(? y". [2 i =t, a 1] ^ 
This gives the descending factorial moments of X, Y. An al v 
t 
Power Series about (0, 0) ernate derivation is through 


хуй») =Ed+4) 0*5) = Уи ЕХ) jy 
* liyt 
Thus, Ex”? Y) = Coeff. of titi /i! j! in W (t,, t,). 
Factorization Theorem for indep. variates. Variates X and Y are ind dent iff 
ependent i 
Gy у.) = G x (t,).Gy(t,) 
Multivariate p.g.f. G(t), t» .- 1) = Бо; зь е... Xe f(x 
= prs А). 
When I1,1<1, V i (isisk); then G(r, 1, 1, ...1) = Gy (т), etc 
1 > . 


8.71. Worked-out Problems 
Example 1. The r.vs. X and Y have joint p.m.f. : 
Ка, 0) = fO, a) = f(-a, 0) = К, -а) = 
where f(x, У) = P(X =x, Y = у). Show that X + Y and X - Y are indep 


§8-71. Worked-out Problems 31 3 
Solution. It pays to use joint p.g.f. Let U = X + Y, V = X - Y. Then 

Mil Ein ^" 5 ) EGGS)" (5) ) 
| КИШ 01. 5-ге, eng" 

= (05 tty +15“ +") 

oo EEG EN +r te) 

= 0) (5 *t57)) 

буг). Gt) 

s that U and V are independent. 
ux and Y are not independent. 

ES , 0 =O, 0) = f,(0) . 0) = 
in set of U as well as of V is 

m v (hs (-2a, -а, 0, а, 2а} 

ie p.g.f. of three discrete variates X,Y, Z is 


| POLICE Y 
праны) en) 


Oz EG 
d 4 


zo. -1) 


v5 $5) ЭР pee 
(b) ia: | ) (2 2^ 34 
"^ б, ) EQ «Y 4 Z)- Ed 


ide onim! 
re ovo 
| si de perve. 


" os 
+ =. j 


MAE 


7 


^ud 
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| (1*0 | | LEgg2) e x, Z2) [== 1 in соу 
(c) С; (1) y fre! n + п qur] | n e : 
i г 2 2 
(1 а 2 Ў [2" +n + (1+ 2 p |" 
P(Z = 0) = Constant term іп С; (1) = x 1+ Ил "ME n nur tn+1) 


(d) Put, =t, 25 1; XY = S; Then 


G;(t) = eel (1050) | s (say). 


" "hd. 1-1]| 
1+1)" nt t(1+f) (1+ £)" +nt(1 +t) 
aj = Ror HE (rs tte] м taot аз" ema «on 
5 (t) ae {2 а, 25 Эр Pih J | 


Put г = 1, to get 


Peal: n _ n(n? + 2n+ 4) 
EG) = Gs) д lis поин) 


Example 3. Suppose (X, Y) Hes joint p.m.f. 
e th) tpy- ie 
fix, y) = Е 


Show that Corr (X, У) = [a/(a + Б)]'? and obtain the distribution of Z = ух. 
Solution. In the following summation, we use 2= х - у. 


29590. 12x. ye x, х+1,. 


© e "*» a> Y 


V SN iia) c (bL) 
балу ВЕИТ 25 н э eer > (at, t; E -—2 
dia 2 бу) 
x20 vzx x!(y - x)! x20 x! Хо Е! 
= e (ath) gh о? (1) 


G,(t) = G(t,)) 2 e'-? = X - Pois (a), so E(X) = Var (X) =a. 


GA) = G(,1) - e**P*-9 — Y ~ Pois (a+b), so E(Y) = Var(Y) =a + b. 
Put гу t = 1 in (1) to obtain 


Gr") = Е) ght- 0 (Y — X) ~ Pois (b). So Var (Y — X) =b. 


From Var (X ~ Y) = сў +07 —20, ay Рху, We at once get 


b -a*(a*b)-2pJa(a« b) = р = [a/ (а  b)]? 
Example 4. Find the joint p.g.f. of the bivariate p.m.f. 


RPT . 
fox у) = i(* A Jro. x20, у21, 1>1-р>0>0. [P+Q=1,ptq=!l 


Determine pyy also. 


$8-71. Worked-out Problems 31 5 
MEME 1° nor 
Solution. The constant k is determined by Normality G(1, 1) = 1. Now 


бйз = EU. y=kd Y kem Jj (pt,)' . (06) 


y=] x=0 


-kX (ЛИР Шуу} [Т (-Ty"= Dit 7 Jr] 


k 2 Eao .(1— pt) " =k 1122) [Apply С.Р. Sum] 
ў= у= l 


| Qt, / (1— рі) |- kQt, 

I-[Qr,/(0)- pt)]] 1- pt - Qt,’ 

By G (1, 1) = 1, we get k = (q — QYQ, so that 

Са) = (q — О) 101 - pt, - Qt) (1) 


* XL. Ig-QUP » 
Gy(t) = Gt, D= QUOC 0) Bx (P+Q=1) (2) 


Recall that for geom (p), G(t) = p/(1 — qt) ; it follows from (2) that X ~ geom [1 – (p/P)]. 
(4- Ол» (1-(Q/9)t; 
(q-Qt,) [1-(Q/q)t,] 
Recall that for gem (p), G(t) = pt/(1 — qt); it follows from (2) that Y ~ gem [1 – (Q/q)]. 
To determine Руху, we need Cov (X, Y), so we find E(XY). 


Gth) _ 2рО(а-Ол , — pq-Q) 


0,0, —— (1-pn-Qr? (1-р -Qty 
д?°С(1,1) p(q*0) ро pq 

eee) puo) ге, (4) 
Ot, Ot, (q-Q) (q-QY (q-Qy 


Now, the known results give 


Gy(t,) = G(,t)- A3) 


E nai. ul M = = 
1 - (p/P) [I-(p/PY (Р-р)? 
1 Q/q Qq 
= LL —,Var(Y) = —~"— = 
Posada (a-gr 
Cov (X, Y)  E(XY) - E(X) E(Y) 
"E. е ИУ. УР oo ac 


"(a-Qy («-Q?» (P-P)G-2 (4-0) 


т ТУРИ: 2: rst о)? = 
KEPT» (4-0) үраРО 
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Exercise 8(c) 


е fair dice will be 9. 
Using p.g.f. find the probability that the sum of eyes on three fair dice 


ih "m at the p.g.f. of the 
A die is thrown repeatedly until either a 2 or a 3 is obtained. Show th E the 
number of throws required is t/(3 — 2t). оу draw 
A bag contains four balls numbered 0, 1, 1 and 2. Suppose л balls are s 4 m 


" . Find the p.e f. 
with replacement between drawings. Let X be the sum of n numbers drawn pe pl 
X and hence show that 


P(X =k)= (7"} (4) &=0,1,2,....2n 


A fair die is thrown 6 times. Let X be the total number of points. Verify that the probability 
distribution of X is : 


К: 6 7 8 9 10 | 
9»: 6), 213, 56), 126A (A = 1/6°) 


For the p.m.f. : P(X =a) = a,0* 1700), х= 0,1,2,...,0>0 where a, 20 and /(0)- Ха Ө", 
show that the p.g.f. in terms of f(0) is G(t) = f(00/f(0). 
Balls are successively distributed among 3 cells. Let X be the number of balls that must be 


distributed to occupy all three cells. Show that the past. OF a ль. 2077 (3 — 2t) (3 - t). 


Let X be the number of unoccupied boxes when n balls are randomly distributed among m 
boxes. Show that 


п т\т у" 
Gi x)= HESS t — py. 
( > Mami Ф 
Hence, show that the p.m.f. of X is given by 
m-k ] ‚л 
[К+ J m Pe 
nn Eev EA 

| 2 J k + J m : 
Let Х|, X,, ... be i.i.d. variates, each with distribution : P(X, =0) = P(X,=1)= Р(Х = Be 1/3. 
Tabulate the distribution of : S, S,, S3, S, where i 


S, = Xi +X, +... + Х,. Verify the following expression : [А = (1 /3)"] 
== == = = nes | 
P(S, =0)=A, P(S, =1)=nA, P(S, =2) A( р ) 
Let p, be the probability that in л tosses of an ideal coin, no run 
appears. Show that 
Q()- Ури" = (20 +41 + 8)/ (8-41-21? _ 73) 


Explain the use of the real zero of the denominator in getting an approximate value of p, for 
not too small a value of n. Obtain a value of Q(t) in case of runs of k heads, 
In a sequence of Bernoulli trials, let P, be the probability of an even number of successes. 


Prove the recurrence formula : Р, =qP,_, +(1—P,_,)p. 


of three (consecutive) heads 


From this derive the generating function and hence obtain the explicit formula for Р,. 


In a sequence of Bernoulli's trials, let P, be the probability that the first combination SF 
occurs at trials number (л — 1) and n. Find the generating function, mean and variance. 


$8-80. Mellin Transform 3 1 if 


12. A anes Кн Bernoulli’s trials is performed until an un-interrupted run of r successes 
is obtaine orr e first time where ris a given positive integer. Assuming that the probability 
of a success 1n any trial is p, (q = | — p), show that the p.g.f. of the number of trials is 


G(t) = p't' (VK - pt)! (1 - t - qp't^ *', 


13. Show that the only way that G(r) and 1/G(t) can both be p.g.f. is that G(t) is identically 1. 


14. "There 15 a desi cd one-to-one relation between the p.m.f. of a non-negative integer-valued 
random variable and its p.g.f.”. Prove this assertion. 


15. Let G(f) = E(r^). For any integer-valued variate X, show that 
07у 2 
1-6(0). У P(X <n) t" = 


127 п=0 


8 


an, Deduce : lim Mog 
Ж t> 


= CX), 


P(X >n)t" = 
0 


n 


Show also that, if 0 < E(X) < o, then [1— G(1)]/ [(1 — t) E(X)] isa p.g.f. 


16. Express |1" in terms of G(r), and also in terms of H(t) = EP(X > п)". 
17. Let G(t,, t,) be the p.g.f. of a pair of integer-valued r.v.'s Prove : 
(a) The p.g.f.’s of marginals Р(Х = j) and P(Y = k) are G(t, 1) and G(1, t) respectively. 
(b) The p.g.f. of X + Yis G(t, t). 
(c) X and Y are independent iff G(t,, т) = С(І, t5) G(t,, 1). 
18. The p.g.f. of X and Y is given by G(s, t) = exp[-A - p — b + Xs + pt + bst]. 
(a) Obtain the marginal p.f.g.'s and identify them. 
(b) Obtain the p.g.f. of X + Y and show that P(X + Y= 0) z exp [-(À + p + Б)]. 
(c) Show that the case b=0 — X and Y are indep. 
19. Let X ~ Pois (A) and Y ~ Pois (и) be independent. Show that the joint p.g.f. of X and Z- X + Y 
is G(t,, t) = ехр (А-1) + р, Гу. 
Obtain the marginal distribution of Z and show that Cond. dist. of X, given Z = n is 


px=riz=m=("\(-25) (45) к< у SR, реА 


8-80. Mellin Transform 
Definition. The Mellin Transform, T(t), of a variate X is defined by 


T,(t)=E(X'), X 20. 


for all values of t for which E(X’) exists. 


Connection. T(t: X) S Е(Х') = E(e/ ^) = M(t: log X). Thus 7y(t)= My (9 
М Remark. Mellin Transform is moment of arbitrary order of a positive r.v. 
Theorem. |f X and Y are independent variates, then 
T(t: XY) & T(t: X) .T(t :Y). 
(n Y) = M(t: X). M(t:inY) 2 TG : X) TG : Y). 


- Proof. T(t: XY) - Ма: XY) = MG in X + 
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Mellin Transformers of В, Distribution and Gamma Distribution 

(i) Let Z ~ B,(a, b), then f(z) =z" '(1- 2^ / Bia, b),0<z< l, a » 0, b » 0. 

p ds git" H B(a-0,b) Г(а+0) _I(a+pb) 


Т@:2)=Е(2°)= | р c=- pab) (a) Г(а+Ь+®) 


= a (a4 b)9, fal! =а(а+1)...(а+0- 1)]. Reverse Factorial 
(ii) If Z ~ gam (А; k) then 


Ayer v TD Xx 

T(0:Z)-E(Z9)- 20) еа = 
Ө: (TQ) QJ 

Example 1. Let X ~ B,(a, b), Y ~ B,(a + b, c) and Z ~ gam (À, a + b) be independent distributed 
Find the distributions of XY and XZ. 

Solution. (i) We utilize Mellin Transform technique : 


а!®! (a+b)! а!) 
T(0: XY) - T(0: X) T(0:Y) = HELD Mu — TT 
ТИХ (a+b)! (a+b+c)" (a+ (b cy 


By Continuity (Uniqueness) Theorem, we conclude that XY ~ В (а, b + c). 


0 ü 
Gi) T: X2 - T(9:30706:2)-— a wer i а 
By Continuity Theorem, XZ ~ gam (A, а). 
Г(а+ 1) Г(Ь– г) а!" 
rar -n 
Exercise. Solve this problem by Transformation of variables. 
Example 2. Find the Mellin Transform of log-normal distribution “ Show that 


Note. If X ~ B,,(a,b), Ty (t) = 


if X ~ L-N (p,,07;), Y~ L-N (n, 02) are independent then XY ~ L-N (u, +, 0? +02) 
Solution. If U ~ N(p, o^), then V = e" ~ L-N (u, в?) Hence 
T(t: V) =E(V')= Ee?) = et, 
T(t: XY)=T(t: X)T(t:Y) = exp[Qut + (afr? /2)lexp [н + (o)? 
-[(p, + pt + 10; +о;)!?] 


[m.g.f. of Nu, o^] 
X /2)] 


Thus XY ~ L-N (p, * 45,0; +03) as gauranteed by Continuity Theorem. 


Life is sexually transmitted disease. (R.D. Laung) 


The most difficult thing is to open a closed mind. 


Characteristic Functions 


9-10. Definition : Characteristics Function 


The characteristic function of a random variable X is denoted by (t : X) or x(t), 
equivalently M, (it), and is defined by the relation 


Муй) = o(t: Х) = Е(е). — (i= J-1). WH 
Existence. The m.g.f. does not always exist, and sometimes it exists only for small 
values of t. However, $,(f) always exists since 

| MGN | = | E(e | < E (l cos ІХ + i sin iX 1) = 1. 
Connection. M(t) = Gle) = (й); ф() Mr = Ge"). 
Note. The word ‘characteristic function’ shall sometimes be written as ‘Ch. function’, 
and o(t : X) will often be written simply as (1) = Mir). 
Effect of Linear Transformation on 9(t) 
M(it : a + bX) = е“! M(ibt : X) 


Proof. M(it vat bX) = Бү PO = Ele еи E[e X] [by Def. & by Lin E] 


e^ M(bt: X). [by Def. of Ch. Function] 
Note. Müt:X-y) = e" M (it: X). 
Linear Combination Theorem 
If X and Y are independent variates, and a, b, c any constants,then 
M(it : aX + bY + c) = е" M(ait : X) M(bit : Y). 

Proof. M(it : aX + bY + с) = EL rye Efe te’ 279) (Definition) 

= e" Ее Е (е?) = el” Маа: X) M bt :Y) [by Ind(X, Y) and Lin E] 
In particular: маг: X + Y) = Міг: X) Mr: Y). [Addition Theorem] 
9-11. Moments through Ch. Function m F 
If E(X") = uw’, 1 <r <n, exist, then y(t) is n times differentiable and ф (0) = (i) p’, lsrsn. 
Proof. Let F(x) be the c.d.f. of X. Since р’, exists, 50 


f \хгаК(ху<® > [^ x e" dFG) «o (1) 


| _©опуегрез uniformly in f. 
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Hence, differentiating the Ch. Function r times [which is permissible Бу (1)] м 
фа) = @ FÉ. x e" dF) > (0) =(i)' wi, iep; 2C) ф 00), I<r<n 


Cor. Maclaurin’s expansion of the function ф,(7) Is 
2 oy п 
фи) = 2. д. +00. 


As г 0, y, = coefficient of (it) ^r | 

Note. Crucial comments on evaluation of complex integrals 

To avoid using calculus of residues in calculating Ch. Functions, by writing it for t in 
m.g.f., is not rigorous unless justified. It produces correct result for normal and gamma 
distributions, as well as many others, but may not succeed with several others, e.g. 
Cauchy distribution (which possesses no m.g.f.). Do net fall into the trap of treating : 
as if i is a real number, even though this malpractice yields the correct answer in some 
cases. However, we accept the formal procedure : 

If M(t) is finite in a non-trivial nbd of origin, we accept ф,(7) = М,(11). 


9-12. Worked-out Problems 
Example 1. Show that if X and Y are independent, then ó(t : X + Y) = $(t : X) . O(1: Y). 
But the converse need not be true. 
Solution. (t : X + Y) = E[e"* * "| = Eļe”* . е] = Ete) . Ee") [-- X & Y are indep.] 
This result is a special case of linear combination theorem. 
Converse. (i) Consider the Cauchy random variable X having p.d .f. 
fix) = Un (1 +x), —0 < x < ©. 
This is known to have the Ch. Function ф(7 : X) = i [89-70] 
Let X, = aX, X, = bX, a > 0, b» 0, then X, + X, = (a + Б)Х. 


фи: X,) = е", 60:X,)- e" Ot: X, + X) 2e ^" => H(t: X + X) =O: X)00: X) 
However, X, and X, are not independent; they are correlated : bX, = ах,. 
(ii) For another example, see Worked-out Problem 3. 
Example 2. Find m.g.f. and Ch. Function of the triangular density 
Дх) 21-Ixl 1х1<1, f(x) = 0, otherwise. 
Solution. Here fo) = (1 +x) 0-1 <х<0) + (1-х) (Os x S ID) 0l xl» 1). 


Му) = Ее) = fae des ра еа = ( (1- 2) еа + [0 = x) e" dx [z 7 - x] 


- fa -s)(e" +e")de=2[ 0-9) cosh tx dx. {Integ. by Parts] 


(cosh г ~ 1) 
ЕЕЗ; (==) - жү 


So ф(= М(іг) = 2(1- cos Л”. 
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TS - --- an 


2) 
ec 3 x. 2, 


Mi) = > n 4: 
[t Br en Lents 


Since 
it follows that E(X) = 0, [= coeff. of г]; Var (X) = 1/6 [= coeff. of 7/2 !]. 
Example 3. Let EF n density of random vector (X, Y) be : 

Дх, у) = (44^) [1 + =! -y)], \х1<а, IyIxa,a»0. f(x, 0) = 0, elsewhere. 
Show that o(7 : X + Y) = $(t : X) ф(ї: Y), although X and Y are dependent variates. 
Solution. The marginal densities are trivially determined, as odd-part of integrand 
yields zero. 


f» f, г-у = 1L. Г, tese ува 


Since f(x) . fy) # f(x, y), it follows that X and Y are not independent. 


EN vr". С ее ване л а =( a) 
ф(7: X) = D: a x= J, Ee = cos tx dx = P 


By symmetry, o(t : Y) = (t : X) sin at/(at). 
We now find the density of U = X + Y. Let x + y = u, x — y = v so that 


1 


= z+) у=5 —————|=—=, ie. dx dy = 5 du dv. 


Е 1 
The joint p.d.f. of u, v is, thus, g(u, v) = (8а?) hi =? (и? = zl 


ШОХ а => и+у+ 2а, у= +а => v-u=2a. 
The density of u is, (use Even-Odd properties of Integral) 


?2а+и 
UM. gu, v) й» + 


81(и) = к и) gu, v) dv 


a 
; itu 2a 1 = 
wo falter eg 


“ E rm el" 4. s 
е 2 
. 2 
2a — 1 — cos 2at sin at 
" E | DE J cos tu du — i = EL А [Integ. by parts] 


e E follows that, (t : X + Y) = $t : X) $t : Y); although X and Y are not independent. 
i 
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Problems with Solutions Provided at the End of the Text 


1*. If р’ = F(n«r)/T(n), find $(0). 
2*. For a distribution, the cumulants are given by 
k, = [(r — 1) !]n, п> 0. 
Find the characteristic function. 


3*. For the median law : f(x) = y, e", —oo« x «oo find p, с M.D. and 91) 


9-20. Characteristic Functions of Some Key Distributions 


Evaluations of Ch. Functions are similar to those of m.g.f. However, the correct 
evaluations in the case of continuous variates needs calculus of residues. We record 
results, using e" instead of е in m.g.f.; proofs are then identical with those of т.р! 


l. Binomial distribution : bin (n, р). $0) = (9 + ре")". 


2. Poisson distribution : Pois (А). o(t) = e^ ^ ^". 

3. Geometric distribution : geom (р); $(t) = p/(1 — ge") ; gem(p) ; ф(0 = pe"(1-— ge") 
4. Neg-bin distribution : NB(k, p); (0) = [p/(1 — ае")1ҝ, 

Pascal N-B distribution : NB* (k, р), &(t) = [pe"/(1 — де"))“. 

Multinomial distribution : М(п; К, p), ф(0) = (ре + p, e^ +...+ р, е)". 
Uniform distribution : unif(a, b) . ф(0) = (е! _ Zi (b — a). 

Normal (Gaussian distribution) : N(y, с>), фа) = e*n, N(0, :6( =e "n 
Gamma distribution : gam (а, А), ф(ї) = (1 ^ ША)“, 

Ехро (А): p(t) = (1 – ША) ; Chi-square : Xin) é(r) = (1 – 210)". 

9. Laplace distribution : Lap (p, 2), ф(0 = E e: rn^. 

10. Cauchy distribution : Chy (a, Б), (0) = M mea 


© o ON UA 


9-30. Necessary but not Sufficient Conditions for a Function to be 
a Ch. Function | 
If o(t) = Mit) is the Ch. Function of the variate X, then 
(i)  $(0)2 1, Mir) = Mit), |o()1< 1. 
(ii) M(it) is uniformly continuous, for all values of t. 
iX 
Proof. By definition, ф(/) = Е(е"). 


) ф0) = Ete’) = E(1) = 1. E (si 
т s = E(e "^ = E (cos tX - i sin (X) = E (cos tX) ~ iE (sin X) 


фа) = соп) E(e’) = conj [E (cos tX) + iE (sin 1X)] = E (cos tX) — iE (sin 1X) 


o(-t) = фа). [m.g.f. does not possess this property] 
| EC 1s Ede 1) = 1. 


Also | p(t) | 


й $9-31. Symmetry Property 323 
ni) Uniform Continuity. I 


rô > 0, define a number b such that 
PX » b) = 1- Fb), PIX < -b] = РБ) < 04 
м the difference A as under 


A = |My [i (t+ 8)) - М, (if) = И: ong - e" уа F(x) 
Р И?. e^ (e^ -ydFG)|« f" Ke** = DIdFG) 

-e9 122 |sn(&)|sa the above yields 

E. 2 


à s 2| [aro f . 


ntegral is independent of t that can be made arbitrarily small by making б 
== 


"o › 


my t and so Mir) is uniformly continuous in ] о, © [. 


„(Б ёл)». (ii) wit)=e"*" 
teristic function because wer 1. 
a because 1 y() |= е" < 
н 22 cimo, а lun 


ic a eds E rs npa 


ЯХ c I na about zero. 
-isin ( е by Lin E. 
| sei Minen i o Re 


і ~ - 

| “а a wx 
n ba D | Ы к ы 

4 “С ы NN 
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9-32. Some Interesting Inequalities 

Let M (it) = M,(t) + ШИ (т). Then 

1. 1 -M,(2t) < 4 [1 М0). 

2. 1-1 Mit) Ê < 4 [1-1 MÇit) l^]. 

3. | M(it) – M(it + ih) «211 — Mj) | , t and Л real. 


M(t) 1 < [1 -M,(2]'”. 


A 


Proof. 1. M(t) = | cosi fy(x)dx — [Def.] B 


| — cos 2tx = 2 sin? tx = 2 (1 — cos tx) (1 + cos tx) < 4 (1 — cos tx). 
Multiply this inequality by f(x) and integrate over ]-00, o» [; then use (1) to recover 
1 - M (2t) < 4 [1 - M]. 
2. This result follows on replacing [М ,(22)]> by | M(2it) l^ in (1). 
The reason is that | M(it) is a real-valued Ch. Function. 


3. | M(it) — Mt + ih) Ê = | fed- e") fo) а, -=<х<® 


SUM |е JfGo [ ax} {f° a- e) О) | dx}, [by C-S inequality §10-14], 
Since [^ |е | JF) [ dx = [` о) ае 10-1720 - cosxh); 


Mit) — М(і + ih) < |> 20 - cos xh) f(x) dx = 2 [1 - M, (h)]. 
If X is discrete, the proof is similar. 


Note. This result also proves that M(ir) is uniformly continuous over the entire range of r. 


1/2 


4. IM (t) | = UL sin tx dF()| < I sin? tx dF(x)| 


ài 5) fi (1 — cos 2tx) aro) = (55) - M,Qn]"^ 
92. m J2 142 
< [1- M, 20] 


9-33. Bochner’s Test 
A function ф(7) of a real variable t on the interval ] —o,  [, is a Ch. Function of a Dist. iff 
(i) (0) = 1, (ii) (t) is continuous 


(ii) (t) is non-negative definite : » 2, b(t; —t,)w, w, 20 
J= = 


for any n, any set t, D», ..., t, of real numbers, and any set м, w;, ..., w, of complex numbers. 

Proof. Necessity : If ф(7) is a Ch. Function, then necessary conditions (i) and (ii) have 

already been proved [§9-30]. We now attend to quadratic form in (iii). The definition 

фи) = Ec”) provides | 
ф,—һ) = Efe), 
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Х it, X42 n iX n n n 7 n X 
OxE[IZw, e * V] [РС e" J £s. e ^ | Ely LwW,e | 
ј= 1 К = | / 


Ш 


PITE YT 


n n EE п п 
= >, >; W; Wy Efe“ Егу dL z. ; Wj Wi, ф (1, f, ) 


j=l k=) j=l k=l 


Sufficiency. We omit the proof of this part. 


9-40. Periodic Aspect of Integer-valued Variates 
We show that Р(Х є 2) = 1, = M,(it) = Мі + 2т)] [Period = 27] 
Converse holds att=0,ie.M,(2mi)=1 = P{Xe 2} = 1. 


(i) Here Z= {..., -2, -1, 0, 1, 2, ...}. For such elements we need to show that M(it) is 
periodic with period 2x. Writing p, = P(X = k), we have 


ad. 
= 
i 


Y P(X =k) = PX eZ) - 1 


E [eit +x] = Y p, gilt +2n)k (у ^ 1] 


k=-% 


M; [i(t + 2л)] 


Y ppe* =E le) = M, (it). 
This shows that M(it) is periodic with period 27. 
(ii) M,(2n1) = E(e**)-E {cos 2nX +i sin AXT = I, (by hypothesis) 
Equating real parts : E(cos2nX)=1 => E{1- cos 2nX}=0 > 
E(2sin? xX) = 0. This holds if sin 2X = 0 = sin kn. Thus X = k, where k = 0, +1, +2. This 
is what P(X є Z} = 1 stands for. 
Integer-valued Inversion Formula 
If P(X e Z} = 1, we show that 
P{X=n} = xL e" Му (й) dt. (1) 


Illustrate the distribution of X when M,(it) = cos (1/2). 
Proof. Since M(it) = Ee" pan eZ, a typical term in R.H.S. of (1) is 


0, if ken 


2х or hi рт ик) P =2 б 
f ae p, at = £ e AM if k=n T p, kn 


This is trivial : [^" (sin Ө, cos 9) 40 = (0,0) 
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Assume that summation and integration can be interchanged*, then 


2л nck 
2n _; : an ы itk К, If (k п) It 
Í, e" M,(it)dt = | е кы by de a [ е p, © 
keZ 


и keZ 


20 p, Sng = 2% p, 


keZ 

This yields the formula (1). 
Second Part : M,{i (t + 4т)] = M,(it), it follows that My (it) is periodic with period 4л. 
For period 27, let Y = 2X. Then 

Mit : Y) = Mit : X) = cos t [periodic with period 2л]. It follows that P{Y € Z} = 1. 
To determine distribution of X, i.e. P(X = n) = р„ we go via a distribution of T. 


1 1 2n -it . Ё d 
Now (x=) = PY ==» |, e My, (it) dt [by (1) with n = 1] 
- x fn e" costdt [е" =cost—isin r] 
xu De a 
- sh cos tdt =~ 
Similarly, P(X = -1/2) = P(Y = -1) = 1/2. 
Thus PiXst12)- 12 wo Tenn -oid-e1[-,1). 


9-41. Ch. Function of Mixtures and. Compounds of Distributions 
Given that ф, $,, ф,, фз, ... are Ch. Function. Then, 
1. Finite linear combination : ad, + bó, is a Ch. Function, ifa>0,b>0,a+b= 1. 


. (-t), (t) and Re $(r) = ¢(®, are all Ch. Functions. 


. Product of Ch. Functions : 9, . 05 ... фу is a Ch. Function ; | $(t) 1? is a Ch. Function. 
. The polynomial а|ф + a,b +... + a,0, is a Ch. Function provided a; 2 0 and Xa, = 1. 
Infinite linear combination : Xa; ф„ 1 < i < oo is Ch. Function provided a, > 0 and da; = l. 
. If G(r) is a p.g.f. then G($(/)) is a Ch. Function. 


Ф ч Ro d 


*Let A= E (Z, e^ "' p,)dt, B={k eZ) 


N ‘ 
N Р 2n da 
2n i(k-n)t =? > i(k ~ nt à 
Ay= , 2 à -j p, dt = h [že p) dt [Finite sums commute integrals] 


We want to show that A y — A as N — ©. So consider 
2n i(k—n)t 
lAy-Alz E Уе p, at 
Ikl> N 
The last result is obvious, as it is tail of a convergent series Ур, = 1, k € 7. 


4 б" phr p, | dt = i Y p.) — 0, as N — =. 
> N ш> М 
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Proof. 1. Let (1) = aó,(r) + Бф), then (0) = аф (0) + bf,(0) = a + nem 


Since ф and ф, are uniformly continuous, their linear combination is also uniformly 
continuous. 


Since $, and ф, are Ch. Functions. Necessity of Bochner's test gives 
26, SEU 20, r=1,2. 
ГА 


E. PH m EMT r x 
29,0; k) №; Wk T E А ДАА z > 0. 


It follows from Sufficiency of Bochner's test that, ф = аф, + bp, is a Ch. Function. 
Remark. The proof trivially follows from 89-42. 


2. To show that фа) is a Ch. Function, we see that the double sum 


Lou, ~)w,W, = conj[ Z4 (=), mjè 0 


because ф(ї) is a Ch. Function. Thus $(r) is also a Ch. Function. 


Now, фо = 1ф+1ф. 


Since ф and $ are Ch. Functions; their proper linear combination is a Ch. Function. 


Note. $4(-t) = фу) (0) ; so ф(—7) is also a Ch. Function. Thus (A) = +ф(@)+ф(—1), 
being a linear combination of Ch. Functions' is a Ch. Function. 

The proofs of the rest of properties all follow, as above, from a direct application of 
Bochner's Test. 

Remarks. Let y(t) be a Ch. Function. Then [6,0] is a Ch. Function iff X is degenerate. 


9-42. Convex Combinations of Ch. Functions | 

Let F(x) and F,(x) be distribution functions of X, and X,. Let Fy(x) be defined by 
F(x) = aF (x) + bF,(x), Osa, b<1; а+р = 1. [convex combination] 

Then, ф(7 : Y) = a$(t : X,) + bolt : X5) = a$,() + рф, (0) [convex combination] 


Proof. ф(т : Y) = E(e) b dF, el, e" dF, (x) [dummy y changed] 


= | e" [аак (х) + bF, G9] af. e" aF Go) + | e" а(х) =аф 0) + bo. (D 
Example : Let X, ~ N(0, 1/n), X, ~ МІ, Wn) be independent. If унин Y = X, with 


Probability 1 — (1/n), and Y = X, with probability (1/n); find 9(¢ : 
Solution. Let Aj = (У = Хх], 2 ; then by Multi-Stage Lr 


AY sx) = Y P(Y < xA A) P(Aj) = (1 - n) P(X, € x) +n P(X < x). Bx) 


j=! 


Let Z~ М0, 1). Then P(X, <x)  P(Z хуп); P(X, < х) = PIZ < Va(x- 0] 


\ 


EC PW <x) = (i-1)& (nx) ++ F; [Vn x - D] 
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So, ФИ) = í Ves 1 b(t) [§9-42. with obvious meanings. | 
n we 
pD = [^ e" ар, (хуп) = | c^ ap) e e T", (а= хуп) 
" eo i -1 i In ^R 
NOR Ге" dF, [Vn (x - D] =e" en dF(z) =е".е Ж A (z= Vn (x 1)] 


$0) = e [ asl e) 


n n 


9-43. Convolution Theorem (Statistical Sum) 

If $,(t) and ф,(г) are the characteristics functions of densities f,(x) and f(x), then 
$C) = $C) $,(2) is the Ch. Function of their convolution fx). — [f — /, * f] 

Proof. By definition of Ch. Function and that of convolution 


f: e" f(x)dx = L go la RO) Р(х y) dy dx 
= Гло) [ е" f, (x-y)dxdy [Put x — y = z in 2nd part] 
= S AOL, e? лсо) |? ло) dy |? e^. f) dz=6,(0) 05(0). 
Example : lf $,(r, Ө) is a characteristic function, then so is Jo, (t, Ө) dF, (Ө). 
Ded "- ; m : IN 
educe that y(r) 15 also a characteristic function, where y(r) = xi. $, (и) du. 


Solution. Let A = |> 6.0.9) ar,(). 


Obviously, ф(0) = 1 and 9(¢) is a continuous function of т. Let us consider 


уфа, tw; W, = УГ, -4. 9f (6)]v, м =[ 129.0, 4,8) w, Јак) (1) 


TA 


Since ф, is a Ch. Function, the bracketed expression in the above integral i 
‘gral is non- 
negative. It follows that the R.H.S. in (1) is non-negative. T T 
| - Thus, Уфа) w, Ж, 20 


and so $(r) is a Ch. Function as it meets the demands of Bochner Т, 
Deduction. We find that est. 


1 | 1 Ыы 1{ e 1 
w(t) = -| ффаи=| -j е" dudF(x),= аф уг 
Á | Г. 4 L xX ij JOP) [Def. of фу (и); integ. w.r.t. u) 


Recall that if X is U(0, x), then ф, (t : x) = (e Е. 1) /ix T 
. 189-20(6)]. A 
integral reduces to l. Hence, the above 
wi) = f” blt, х) АЕ). 


By first part, this is as well a characteristic function. 
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9-50. Summary of Some Fundamental Results 


1. Marcinkiewiez Theorem : If $(r : X) is of the form e", where P(t) is a polynomial 
in t, then P(t) must be of the form P(t) = iat — лг“, a and h being real. 
"- TNR l 
It follows that e " is a characteristic function, iff В = 2. 
[Proof of this theorem is beyond the scope of this book] 


2. Polya's (sufficient but not necessary) Conditions : $(t) is a Ch. Function if 


(D $0 = l. (2) o(t) = $(-1). (3) $(f) is continuous. (4) lim o(t) = 0 


(5) (ft) is convex for t > 0, i.e. for bis ty 2.0, Ф|. +h) 2[ф 0) +ф0, ]! 


Non-necessity. If X is N(1, 1), then ф(т: X) = е” ” But ф(—г) + ф(г). This shows that 
the above condition are not necessary. 


Note. From Polya's conditions it follows that functions such as е! and n Tr a are 
Ch. Functions. 


3. Cramer’s Criterion : A bounded and continuous function $(r) is a Ch. Function iff 


(i) (0) = 1. Gi) wx, A) = f^ [^ фои) e" dt du>0. 


w(x, A) is real and non-negative, for all real x and for all A > O. 
4. Test for a function not to be a characteristic function 
Theorem : If ф(ї) is not constant, and if for small f, 
o(t) = 1 + g(t) + 0(1°), (t : small) 
where g(—r) = —g(r), i.e. odd function and g(t) = O(t); the ф(7) is not a Ch. Function. 
Proof. Let ф(т) be a Ch. Function, then 


wt) = o(t) d(-t) =1+ 0C) 
is also a Ch. Function. М for any Ch. Function $, with t and Л real, 
фо) - фи + A) P < 26(0) 1900) – $400], 1900) = 1]. [89-32] 
We apply this inequality to the function y(t) and obtain 
| y(t) - wa +h)? = oc) 
So that y'(t) = 0 everywhere, which results in a contradiction. 


Remarks. e" e" " (n» 2); (14 15)! are not Ch. Functions. 
9-60. Inversion Theorem 


If x(t) is the Ch. Function corresponding to с... F(x) and (a - 5, a + 5) is a continuity 
interval of F(x) then 


F(a + 8) - F(a -8)- lim p. sn e фа) а. A) 
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Proof. Consider the integral 


| (T 8іпӧ -im fo A(x) dt. 
J IT Lg sin E e" olt) dt = Sis ; Y || 


A Н р so that J с; 
Since | (sin 8t/t) e каса < ri the order of integration can be interchanged so that J can 


be written as 


bo 


1 ro T sindt а-ә y= [^ (Т, x) dFG) s 
Jw [D FON mrt be 


1 f. sin бї cos(x — a) t dt. 
t 


h = 107 Sinót g 179 qul 
where YT, x)= Lf Sh ue д1 
Note that the second term : (sin 6#/t) sin (a — x) t, in the integrand, being 41 E 
function of 7, its integral over [-T, T] is zero. We now изе: 2 sin A cos В = sin (A + 


* sin (A — B), and above gives 


T sin(x-a+6)t 1 (т sin (ô - a — x)t А 
yer, x)= | Sm ar Oe L p Bta ж s 
Now recall the well known E } 
iar 1, if A>0 
xh dro l0 if i-o (A) 
EROR -1, if A<0 


Now letting T — © in (3) and using (4) we obtain 


0, forx«a-9 or x>a+58 
lim (T.x) = 5, forx=a-—5 or x=a+8 
l, fora-ó«x«a-48. 
Observe that : A the first case, y + -4+1 2.0777 =з >); in the second case, 
y — 0+ Lor +0; in the third case y — 141. 
f 2 T i 
Furthermore, | y(7, x)| is bounded, since D (sin A7)/t]dt is uniformly bounded in T. 


Hence by usual Lebesgue dominated convergence theorem, we find that (1) yields 


4 [ war.) аР) = [„ lim (Т, x) аР) = [O° aFQ) = E 8)- F(a — 5) 


Remark. If there are two distribution functions, the 
both the distributions and hence are identical. 


Cor. If | $(t) | is integrable, then from (1), 
m Fa T $) – F(a- б) _ 3 = [° li sin бї is 
hm 26 = Ba -0 Du бї Je (t) dt 


y agree at all continuity points of 


La. е 5 O) dt. Equivalently : f(x) = x fee dt. 
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9-61. Inversion Formula 
If (1) is the Ch. Function of a variate X, then the density f of X is given by 


ie s 
Fla) = = [eod wAY 


Proof. We give a formal proof based on the properties of Dirac delta function : 


A 
2л 


We consider the r.h.s. of (1) and insert the definition $(t) = fe” FO) dy in it. This gives 


Вж“ Дь. 869; [^ fo» d(x — y)dv- f(x). [Shifting property] ...(2) 


1 © itx 1 -ix |f? iw 
F “40 dt = M e" m e? f(y) dy! dt [Change Integ. order] [by 5-properties (2)] 


со 


A 1 -й(х- у г: 
= fo) E T сыч. aas - f" fQ)8(x -u) dy = f(x) 


Another Proof. A standard integral from Advanced Calculus is 


–1, а<0 

ЫГ SIRA s =~ 0, a= 0: 
Nr- t 

L. a> 


Consider a function g(t) = (1 — cos at)/t. It is an odd function of t, so integral of g(t) 
over a symmetric range ] —, oo [ is zero. We add this to the above result to get 


| р –1, а<0 

AN sin at + i(l — cos at) 4; 04.0 
Go t 

база О, 


Now use e” = cos at + i sin at, put a = X — x, multiply the above integral by 1/2, then 
add 1/2 to both sides, this gives 


: E Lo x 
Be. M it(X — x)t , 
ui m. CHRIS TTA tobi) 
2 1л”— t 
Ops Xi x 


For a fixed value of x, the Eq. (1) is a function of the variate X, hence we treat it to 
define a new random variable Y. Obviously, 
Y = 1 with P(X <x); Y= 1/2 with Р(Х = х); Y = 0 with P(X « x). 
E(Y) = 1P(X «x) + 5 Р(Х =x)+0P(X> x). 
x) = 0 if x is a point of continuity in the distribution of X. 


Since X is continuous, P(X = * 
E E(Y) = P(X <x) = Fy). .(2) 
Taking expected value of the first two members in (1) we get 
F . -ixt 
| qu QUEP SU abe PS TENE ЫЕ 18 263) 


2п = 
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Eliminating E(Y) between Eqns. (2) and (3) ; then taking derivatives, we get 
f(x) = + f^ eed, be РО) = ЈО?) ea) 
п --% 


Equation (4) is the inversion formula (or Fourier Transform) for a Continuous Distribution. 
Comments. Inversion formula is applicable if we know that ф(ї) comes from a continuous 


r.v. which may not be true. There is no nec. and suff. condition on ф for it to be from 
a i PE ГРЭМ 7 (i.e. finite). Howeve 
continuous r.v. A sufficient condition is that at Ip(t)ldt< (т.е. Г, 


this condition holds for Normal distribution, but not for Expo (А). We are stuck ! 
Inversion in case of a discrete variate : A standard integral formula is 


ү (ѕіп ak)/ ak, a#0 
zT a= | ] M o 
Take a = X — x, proceed to limit as k > oo to get a new variate Y defined by 
А É k i(X - x)t мё ОК x 
Y = lima Je a- D LT 
SÔ : E(y = 0 P(X +x) +1 P(X =x) x P(X =x) 
Р(х = ee f&eLun ds d I s. a 
xx) lim di [р Ele ]at lim oe at y(t) dt E) 
This is the desired Inversion Formula, 
9d Ж 1 —itx . 
Note. but), = Г. e f(x) ах; f(x) M e" p (t)dt, [X : continuous] 


» itx, 4 E TM M n р 
b(t) = E, e" py (x); Py(x)= lim = J Bi y(t). at, [X : discrete] 


Remark. The p.d.f. for discrete variates can, generally, be read directly without 
resorting to their Ch. Functions. 


9-62. Uniqueness Theorem 
The characteristic function uniquely determines a p.d.f. 


Proof. If possible, let there be two p.d.f.’s say f, and f, corresponding to the given Ch. 
Function (t). Then by Inversion theorem g 


ло = P, sel tou 
T 


But this shows : fj(x) = AQ) ; whence the result. 

9-70. Ch. Function of Cauchy Distribution 
dba eo 
п[А? € (y - ay] 
Recall : If X ~ Lap (a, А) then its density and Ch. Function PA 


gly) = о Y «o: y(t) = g^ ^1"! 


-Аіх-аі 


| 
ы шыл А 2 гъ 
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І T —itx 
Also : fix) = ax li o(t)e "^ dt (Inversion Formula) 


We substitute the results of f(x) and $(r) simultaneously in the Inversion formula to get 


1 жае. al Е po 2 iat -itx 1 
5 \ е i. MH. QUE о 
= oe Put a—x = Ө 
2 2T ie М crt l 
"Ww itO d S i8(y — a) 
пе. Ep ox — Е. і =* [ E [v - a = t] 
пе Ке пле (у-и) l 
This we may rewrite as 
z re?» dy © Өү 
їаӨ-А\Ө1! = Беата ae rn е! ) . g(y) dy p 1 
К Е nit +(y—a)’] L. z 
À 
where g(y) = —00« у 00:5. A> 0. "rs 


п [0 *(y-a)]' 
Eq. (2) show that g is the Chy (а, А) density and Eq. (1) gives its Ch. Function. For 
usual familiarity, change Ө to г in (1) and thus. 


$,() = exp [iat — №21]. 


Direct Evaluation. From “Calculus of Residues”, we borrow evaluation 


o cos tx dx 
i o alam т (1) 
b! x) 
Now f(x) = pma. b»0;-ocx«o 
B Eo) 
pt- À o b e“ dx be oro е! dz 
Mit = E их ү = ne ЕЕЕ Kc rl [272 x— a] 
ape bebes b+(x-ay т ls Б +z’ 
= Ё оа E cos tz dz Г acr е" = cos = isin | 
y T —o0 b? +27 00 b TZ 
i 2e" Ren = Qa biti 
9-71. Sum of Two Independent Cauchy Variates 
Let X ~ Chy (a,, b,) and Y ~ Chy (а), b;) be independent. Then 
(X Y) ~ Chy (a, + à; b, + b,). ST) 
Proof. Here y(t) Ра airs ut oy (1) - e^ '- ^t" 
$G:X Y) = $4().0,() o e 1 mnm 


This shows that result (1) holds. 
Cor. 1. If indep. X, ~ Chy (ap b), 1 < k < n, then $, = X, +... + X, is Chy (Za, ХЫ). 
Cor. 2. |f X,, ..., X, are iid. Chy (a, b) variates, then X, = (S,/n) is also Chy (a, b). 
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(8) е) 


9-80. Joint Characteristic Function | E... 
Definition. The joint Ch. Function of two variates X an IS g 


5 o ро it, x + if y d ly. 
bx (6.15) = Efexp ДХ +) = | [, fe ne x d) 
where г, and 7, are real numbers. : 
By setting г, = 0 or t, = 0, the Ch. Functions of X and Y are obtained, the so called 
marginal (individui) Ch. Functions : 
фу) = $(5,0); by (t,) = (0, 2). 
The joint moments can be obtained as follows : 
RES gu ф(0, 0) 
Ot, Ot; 
Using inverse Fourier transform, the inversion formula is 


Ecx’y*) = (-) 


fr.) = GS m ers f. фо) e^" ar, а. 


Factor Theorem. The jointly distributed variates X and Y are independent iff 


x y(t}, ty) = фу (6) by (t), V t,t. 
Proof is similar to factor theorem for m.g.f's. 


Example 1. If 6(t,,t,)=exp (—2t; – 855), show that X and Y are uncorrelated. 
Solution. Recall Е(Х' Y*) = (-i)"" 01 p =8/ ax, 0, = 0/8y]. Now 
0, (5,05) = — 4, (1,2), 050,1) = — 161, фб, t), д, д, (t,t) - 64 1,1, (t, t.) 

E(X) = (700, 6(0,0) - 0, EY) = (-i) ð, ф(0,0) = 0, E(XY) = (~i)? 0, ð, 6(0,0)=0 
Since Cov (X, Y) = E(XY) - EX) E(Y) - 0, it follows that X and Y are uncorrelated. 
Note. ф(1,,1,) = (,,0).6 (0,1), which shows that X and Y are ind. Gaussian variates. 


Example 2. Let $(t,,1,) = [(1 = 2it,) (1 — 2it, p"? 
Obtain Var (X), Var (Y) and Corr (X, Y, 
Solution. Firstly we carry out the partia] differentiations needed for various moments. 


9,0 (4,2) = in(1— і) "m7 (1- 2it, >”? 


‚ [n>0, integer] 


> ô $(0,0) =in 
05 O(t),t,) = in(1— 2ir,) "2-1 {le 216 yan д, $(0,0) — in 


0,9(5,1,) = i^n ope it 0-20. dip у-н. a (0,0) = — n(n + 2) 
AUT — 
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BENE) на 0-22) "?-'-2:)92-! : а, ф(0,0)= – п? 
Recall : E(X Y) = (=) ** 01 05 ф (0, 0). 
E(X) = (~i) (in) =n=E(Y), E(X*) 2 n(n +2) = E(Y?), E(XY) = n(n + 2). 
Var (X) = Var(Y) 2 n(n + 2) – п? =2n; Cor(X,Y) =n? -n° =0.рұу =Sxy/Fx Sy = 0. 


Comments. Obviously : $(t,,t,)(t,,0).6(0,t,) which means X and Y are independents 


and by symmetry, identically distributed. So one-variable evaluation is sufficient. 
However, the above evaluations are instructive. 


9-81. Worked-out Problems 
Example 1. Prove that the following conditions are equivalent : 
(i) My(c) = 1, (i) P((c/2n) X e Z} = 1, (iii) My (it) is periodic with period Icl. 
Solution. Let us put (c/2x) X = Y, i.e. X = 2nY/c. Then M(it : Y) = M (cit/2n : X). Now we 
attempt sequentially : 
(0 => (Qi) Since M2zi : Y) = 1 > P(YeZ] = 1 [89-40] > P{(c/27) X є Zy = 1. 
(ii) => (iii). If P(Y € Z} = 1, then M{it : Y) is periodic with period 27 [§9-40] 
Since M(it : X) = M(it : 2nY/c) = M(2z it/c : Y), so this yields X is periodic with period | c |. 
(iii) => (i). As M(iO ; X) = 1, so M(it : X) is periodic with period | c 13 
Example 2. Find the distribution for which Ch. Function is 

фа) = 1-It/al, Itlsa; o@)=0, Irl»a. 


Solution. By Inversion Formula, the density f is 
Tus m - e" o(t)dt= =. [ÉL (cos tx — i sin tx) [ -— uH dt 


= 1р е = £) cos tx dt. [By even-odd properties of definite integral] 


г \( sin tx \_ dj —cos tx |l 
NU = ( 3 = | ( = [me J [Integration by parts] 


Thus, f(x) = (iz cosax) LOLS LO 
лах? 
Example 3. (a) Show that if (¢) is a Ch. Function, then | p(t) | need not be a Ch. Function. 


(b) Show that e" is not a Ch. Function. (c) Show that y(t) = exp(—t") cannot be a Ch. 
Function unless a = 2. 


Solution. (a) Let (1) 


ža + 2e"); it is Ch. Function of bin (1, 2/3). Now 


eo? = e080-(1)b «22 +27]. 


—M 


3936 — 11 1 1  -guminticFueiee — — 


Let wit) = 1o(t)l= pe" + gel”, say (р+4= 1). Then 


+ 


p Fa 
РА. j 


i ih (а+Ь) (1 1 ji 
[wv (P 2 DOL > pew " gen" & 2pq e ~ (1) 650, 


This result is true for all г; take a + b = 0,a- 
Obviously, these equations are incompatible; we infer that | o(¢ 


(b) Assume that y,(r) = e" is a Ch. Function. By analytic expansion 


Welt) = 1-15 GEV ЕШ] SE QU). so that. Var (X) = 0 


р = 1/2; then 2pq = 5/9, р? = д? = 2/9 
)lis not a Ch. Function 


Thus X is degenerate with P(X = 0} = 1. As such $,() EC" )7 l. 
But then ф(г) = w(t) as e 1t z0). 
(c) Іа is complex, a = re^, then W(t) = exp ae y(-t) = exp EO ) SO Y-t) 
= W(t). Thus, if y(r) is a Ch. Function, a has to be real, further 

VO - wt) 2 exp(-i*) s exp (-1)* r*) = (-* 21,500 72k, k-0, £152... 
However, a = 0 yields y(t) = exp(-1) = const. and there is no distribution with y(t) = const. 


For а = – 26 (К »0), (е7, so as t > 0 we get y(0) = e ^ = 0. This contradicts 
y(0) = 1. So а cannot be an even negative integer. 
For a = 2 + 2k, (k > 0) analytic expansion yields 
y(t) a ехрс +80) = 1 = #2* 2k T Ort? 
Here E(X) = 0, EO?) = 0, since terms і and f are absent. Hence Var (X) = 0, so that X is 


degenerate with o(t) = е?! = w(t). Thus, a cannot be of the form 2 + 2k. For a = 2, w(t) = C 
which is Ch. Function of №(0, 2). 


Example 4. The continuous variates X and Y have the joint Ch. Function ó(!,. t) 
Prove that the Ch. Function of X given Y = y (fixed) is p^ 


y(nly) = Wee a $0.5) at, [| e $(0, ty) ап. 
Solution. The p.d.f. and Ch. Function are connected by the inversions 


D fe —itx © Е 
fix) = 2n f фо) а; g(t) = [^ е!“ 350 d 
Now, we use Double-E Rule as under : 


inX үу i it { 
$t, t2) E enum -E, {E,(e S^ ah ly)} =E, le^" Ee" ly} 


iY © ilh 
Ее? у ТУ) = f^ e^" wo, ly f, (y) ay. 


We invert it to get 


1 sity) 
wt IY AW) = 5c], " $5.1) dt. TU 


o— — Exercises 
When г = 9, w(0.! y) = 1, so, 


l 
f) = = Эл 


Eliminating f,(y) between (1) and (2) provides the stated result. 


Је" (0,5) dty. 02) 


Problems with Solutions Provided at the End of the Text 
1*. Point out, which of the following are not Ch. Function : 


o,(t) = 1/(1 +7), 6,(t)=sin at, $4(t) = cos bt, ф, (1) = 1 it, b<(t)=tbnt 


$s(r) 9 1/1 0^), $50) = exp (it). 
2*. Find the distribution of a г.у. X, if ф, (0) = 1/(2e"" - I). 


3*. Find the distribution for which Ch. Function is (tf) = e^" , 4 »0, – о «t «o. 


4*. If X, Y, U and V are variates with joint density 


(21)? exp[-4 (xt уи? + 29]; Ев 1 "ie 


show that Z = XY + UV has the density f(z) = 1e, -w<z<o. "i 


5*. If X, Y, Z are independent N(0, 1) variates, find the characteristic function of the 
pair U, V where U = XZ, V = YZ. Deduce the Ch. Function of U and prove that U 
and V are not independent. 

6*. Find $(5,1,) when f(x, y) = (1/27) cos (x + y) rect (x/n) rect [(x + у)/т]. 

7*. Show that it is possible that two different (discrete and absolutely continuous) 
distributions may have the same Ch. Function on [-1, 1]. 


8*. If X is an integer-valued г.у. and $(r) = E(e" ), show that 
P(X 20 (mod k) } = i: Š (=) 
Exercises 


1. (a) Show that if $(f) is a Ch. Function, | ф(г) 1° is also a Ch. Function. 


(b) If X and Y are i.i.d. variates, show that $(r: X - Y) =1ф (t: Х)Г. 
(c) Prove that (cosh mx)", | x | « oo is a p.d.f. and find its Ch. Function. 
2. (a) Recognize the variate X if the characteristic function of the variate X is 


by(t) = E + Ө “| . exp [-3 "mu | 


itm 
(b) If $4(0 = ——ÀM ol , find the p.d.f. of X and evaluate E(X) and Var (X), the principal 
[1 + (67 /2)] 
distribution characteristics. 
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10. 


11. 


(c) If M,(it) = (2 + e")1727, identify X. 
(d) Show that [2 – ОЕ is a Ch. Function. E a. 
Let X be an integer-valued variate and ф(2: X) its Ch. Function. Prove thé 

н РЕА FLZ.. 

2п т | ^N 

Let the c.d.f. of the variate X be absolutely continuous. If the p.d.f. of X is k times differentiable 
(к= 0, 1, 2, ...) and if 
lim (£116 (1:300 70 


i300 


az b | f(x) I dx, exists for j = 1,2, ..., k, show that | 


(a) Let X be a variate such that E(X) = 0. Show that 


Exp tye 1% a. 


-—00 T 


(b) Let X ~ N(0, Ө) and g(x) be a function such that e "g(x) — 0 as!x1— o. Using Ch. 
Function, or otherwise, prove that 


a 1.42 80) _n(n=1) 99 
аө E (80) i be fa 1, (0) —7— |, us 2) dt. 


. For any real characteristic function g(t), prove the inequality 


1+ 6,20 > 2 [69 (O7. 


. (a) Let X be a continuous r.v. with c.d.f. F(x). Find the Ch. Functions of Y = a + b F(X) and 


7 = № ln F(X) and recognize distributions. 
(b) Prove that for u » 0 


3 7 pu 
[мел © FOS HO - $9021 J dF) ST ftt фола 


. Suppose that f is the density of a variate and the associated Ch. Function $(1) is real-valued, 


non-negative and integrable. Show that kf(u), -œ < и < œ, is the Ch. Function of a variate with 
density ф(х)/27, where К is so chosen that k f(0) = 1. 


(a) Let $(t) be a Ch. Function. Show that the followings are also characteristic functions : 
exp (A [ф (t) - 11); @ cosh ф(2/соѕћ 1; sinh [ф(2)]/ѕіпһ 1; (1— a) $(t)/[1 — афр). 
(b) Show that if $,(1,) = 1, for some fọ #0, then X is of lattice type assuming the values x, = 2n 


Let фт) be a Ch. Function of a non-negative variate X whose kth moment p’, is finite 
: . 


Let $, (0) =[@* wT 6% (0) 

where $'? (1) is the kth derivative of $(r). Prove that $,(r) is also a Ch. Function. 
i 1 1 

(a) Show that if P(A)= 2 I (0) + s f 1,(х) ах, then 


M,(it) = (1/2) + (sin 21). 
(b) (X, Y) is a 2-dim. variate with the possible values 0 and | for 
both X and Y with joint probabilities as shown. Find the Ch. Functions 
$, (D. Q-C) and фу, £5) for X, Y, and (X, Y) respectively. Show that 


12. 


13. 


14. 


15. 


16. 


17. 


18 


19. 


20. 
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$^, t) = (ti) > (15), iff Poo Pit = Poi Pio: 
Find necessary and sufficient conditions for X. Y to be (i) uncorrelated, (1i) independent. 
(c) Find the characteristic function for the distribution 
fü, 1) =f, -1) = 1/6, f(-1, 1) 2 f(-1, 21) = 1/3. 


Prove that the real part of a Ch. Function is again a Ch. Function. Prove further that, if ф, (1) 


= a(t) +ib (t), and ф„(ї) =a,(t) + ib (t), are Ch. Functions, then a, (t) a,(t) — b, (t) b(t) isa 
Ch. Function. 


If X and Y are non-degenerate variates and X/Y and X are independent, prove that X/Y and Y can 
never be independent. 


‘ (n) es со (e" e. 1) x 
Show that, if x ^ = x(x — 1) (x — 2) ...(x—-n + 1), then e" = = a 
n! 
Deduce that ру, = [D' $(t)],_9, where D = d/d(e^). 
Find the distributions, if they exist, for which the Ch. Functions are given by 


(a) (q + pe^", (b) Em (c) e", (d) = cos 2t + i COS f. 


Given M,(it) = 2/(3e" — 1), M (it) = : XN 1 * e?! , find the distributions of variates X and Y. 


If Z=X, +X,+...+X,, where X/'s are indep. variates with Ch. Function $,(r) and n is a variate 


п 


taking on the values 1, 2, 3, ... with Ch. Function ф, (2), show that ф(т: Z) = $5[-i bn $, (1)]. 


Let $i (H = Xa, cos kt, ф, (t) = La, e™ O<k<1, where a, 2 0 and Xa, = 1. Show that $, and $, 
are Ch. Functions and determine corresponding densities. 
Suppose $(f) and F(x) are Ch. Function and c.d-f. of r.v. X. Show that 


lim J, = Р(х +0)— F(x - 0), where J, =+ f ет" фа). 
bs 7 526 d 
For a continuous г.у. X with Ch. Function $(f), show that 
ixt 
dt. 
it 
Deduce that two continuous variates with the same Ch. Function, must have same c.d.f. 


F(x) — F(0) = >= lim [^ 60) 


If you try you risk failure but if you dont, failure is certain. 


dene see eT HEHEHE CHM A AAA MAE 


^ 


ot wur tm 


y "m А 
=) ~~ 


gill) SEE 6577 
"E t. DY ч 
ete ш 400. 


EA 
NS m 


mM AL T. 


Nature ts not human hearted. But nature never breaks her own laws. 


(Leonardo Da Vinci) 


Some Probability Inequalities 


n ини 
To compute exactly P(X € S} is not always easy. However simple bounds on these 
probabilities are often sufficient for the job at hand. We thus consider such bounds 


10-10. Biename-Chebyshev’s Inequality 
Let X be a г.у. with E(X") < œ. Then for any constants b and c > 0, 


P(IX-bi2c] < 


ede. P{IX—bl<c} 21- 


ad RJ 


r 


,EIX-bl EIX-bI' 
с" 


Proof. Let X be continuous with p.d.f. f(x); the discrete case is very similar. We define 
the events 


A = {x:lx-bl2>c}, B={x:lx—bl<c}. 

M eb sd onion те. 9I74 UB 

= | fœ@1x-b d+ f f@)lx-b! dr > f f@lx-bl de [Part of above areas] ...(i) 
> | Ро) с dx [on А, 1x-bl2c>la-bl'2c] 

= c | f(x) а= с .P(A)e e PUX - Б> c) 


This yields : P(IX — blz c] [E(X - b]/c'. 
By Negation Rule РХ —bl<c}= 1- P(IX Б> с) and thus the other result follows. 


(i) Markov Inequality : P{\X\2c}sEIXI/e. 
Take b=0, r= 1. 


- Var(X) , 
(ii) Chebyshev’s Inequality : P(IX — „арЫ, ie. P(IX-pl«c]21- 
є 


Var( X) 
c? 
Take b = E(X) = p, r = 2. 
Note. A generalized version of the above inequality occurs in §10-12. 
A note on Method : We generally record expected-values and then drop (truncate) 
some positive terms to get the inequalities of our interest. See Eq. (i) above. Mark the 
wing problem for this method. | 
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Example 1. For the integer-valued variate X, let P(X = k) = p, 
k = 1, 2, 3, ... Show that p, < 2u/k’, where н = E(X). A 
Solution. Observe : p; > p, for j < К. We use positive-terms truncation : 
k k k k ER k(k + 1) 
Е(Х) = X јр, + X jp;2 У јр, > У jn. =.) i= Pi 2 
j=l jake) j- j- je 


=k 


be non-increasing in 


i. 
22 pu. 


Thus E(X) 2 ‚Р => p,s2yu/K.. 

Example 2. If X and Y are i.i.d. variates, then P{ Paar mer» ue 

Solution. Observe : (IX -YI2 1] c (IXI»1:) U Y 1» 21] 
P(IX-YI21&P(IXI»1:)e P(IYI»1]-2P(X» 110)... 

10-11. One-Sided Chebyshev's Inequality 

(i) — If Y (0, o^), then for any a > 0 and o? < o. 


P(Y2a) < o?/(à +0") (Y>0) tet 
(ii) However, if X ~ (u, o°), then for any a > 0, с? < œ 


A с? 
Р{Х > & s—— РА ЕИ oS 
lad iil! Mig © IRS Fi a 


2 2 nz ) 
as 996: 


Proof. We shall use Markov inequality : P(Z > b} < Eleh- f£ >0] 


As (Y 2a) = LY + (с> /a)] 2 [a + (в? /а)}, adding a constant, so 


(i) P(Y >а} = P{Y +(6*/a)>a+(o?/a)} < E * © /а)] 
at (O^ n) 
с2/а в? | | 2 2 
Piy > < ———— = 2 m a Wd 
Thus { a} (à! + 0?)/a а? +в? E Y + P |е > : һу -о| 


(ii) LetY2 X-porY-p- X; then E(Y) = 0, o? =0} =0? 
P{X-p2a} = Р(Ү>а)<в? /(а? + с?) 
Thus P{X>a+p} < с? / (а? 497 
P{(u—X)2a} = P(Y2a]xo! / (d +в?) 
P(Xxp-a) < с? /(а +0"). 
ae of Chebyshev’s Inequality 


1. Chebyshev’s inequality is valid without any assumption relating to the form of the 
distribution of X, the only requirement is the existence of Var (X). Consequently, it is 
applicable to a wide variety of distributions. i 
2. If the distribution of X is known, a better bound can usually be determined. For 
known distributions, the calculated P( | X — u | с) may be much lesser than the upper 
bound supplied by Chebyshev’s inequality. However, there are distributions for which 
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the uppe" bound is actually attained. Thus, the upper bounds, in general, may not be 
improved upon. 

3. Chebyshev's inequality is not only valid for absolutely continuous and discrete 
E ды i^ ү for such variates which do not fall in these two special categories, 
rovided that their variances exist. 

4. Since P(IX - u | < 30} = P(p - 3c < X <p + 30} > 8/9, it follows that every density 
must concentrate most of its probability within a few (three) standard deviations of its 
mean. This explains importance of 3c limits in Probability Theory. 


Markov's Inequality (Independent Proof) 
If X is non-negative variate, then for any a > 0, P(X > a) < [E(X)/a]. 
Proof. Let X be continuous with p.d.f. ‘f? Now by definition 


Ene f xf G9 dx - (f f )af(x)dx> [^ хло) ах> [^ a f(a) dx 


aj f(x) dx - aPGc 2 a). 


Thus, P(X > a) < [E(X)/a]. When X is discrete, summation replaces integration. 
Cor. Let X be an arbitrary r.v. and b, n be arbitrary constants. Then 


P(IX-bl2c) < [Е(Х-Ь)"]/с". [Bienayme non-central Inequality]. 


Proof. The r.v. Y = | X — b l”, assumes only positive values. Applying Markov's Inequality 
to Y with a = c", we get 


P{IX—bI">c"} < E(X-b)/c > PUX-bI2c) sEQC- Б)" 1c". 
Chebyshev inequality flows out when b = p and n = 2. 
Chebyshev’s Law 
Let {X,} be a sequence of r.v.’s with E(X,) = р, and Var (X) = с2 «oo for all n. If 
o 0 as п — оо, then 
lim P{ | X,-u,!2e} = 0, as n > œ TJ 
Proof. By Chebyshev's inequality : P{I X, — р, | > €} < (с2/2), v &»0 
Let n > oo, and c? ә 0, then above inequality instantly reduces to (1). 
10-12. A General Function Inequality 


Let X be а г.у. and g(X) be an arbitrary non-negative (integrable) function of the values 
of X which the r.v. X can assume. Then, provided E[g(X)] exists, with c > 0, r = 0, 1, 2, ... 

P(g(X)» c) < E[gQOT /с', ie. РІ8(Х) <) 21 —E[g Xy /с' NO 
Proof Let A = fe: g(x) 2 c), B={x:g(x)<c}, so that {-0<x<o} =A ict. B. 


m Cu дм. i3 
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Suppose f(x) is the p.d.f. of X. Then 


Efexyy =f BON foo dx | gol fd ах = J [gol fx) de + Jago F(x) dx 


>| [soy f(x) dx [Part-Area of curve [g(x)]’ f(x) on sub-interval] M ig 


Now on A, [g(x)]’ > (c)', hence (i) reduces to 


ELO] > J," ЛО) dx = OY f, f(x) dx = C . PLAT. 
This amounts to, with A = {g(X) > c), the result 
P(g(X)2c] < E[gQO] /с", г = 0, 1, 2, ... 
The companion іп (1) is negation-statement P(A)= 1— P(A). 
(1) Markov Inequality : P((X)2c) € E(X)/c. 
Take OX) = X, rx T. 
(п)  Chebyshev's Inequality : P(IX—yl2c] x Var (Х)/с? 


Таке g(X) = 1X=-plr=2,, Var(X) SE(X - M. 


(iii) Bienayme-Chebyshev’s Inequality : P(IX - blz c] xEIX -bl /c" 
Cor. Generalized Bienayme-Chebyshev's Inequality : 
РОТЕ ВЕСЕО к= ОЛ, 2... (2) 


Proof. The non-negative non-decreasing function g, attains the value с = g(k) at x = k 
and g(X) > g(k) <= X > k where X > 0. Thus (1) yields. (2) instantly. 


Note. (i) g(X)=e% = Р{Х>а}< Ма)/е“ 
(ii) g(X)=X? => РІХ>а}<Е(Х?)/а? > P(IX- plz a) xo? /a. 


Comments. The virtue of Chebyshev's inequality is its generality (distribution free 


property) and not its sharpness. Chebyshev's inequality supports the interpretation of 
the variance as a measure of the tendency of a variate to deviate from its mean. 


Case of Var (X) = 0. In the extreme case, when o? = Oheen A(X son) = 1. 

If o? = 0, then P{ |X - ul « c) 2 1 - o^/c? = 1, V c > 0. Take с'= 1/п and let n > ©. 
Then c — 0, and using continuity of P we have P(IX —pl=0}=1. 

Consult Example 3(e) §10-21. 

Cor. 3. Bernstein’s Inequality : P{X>c}<e"M,(t), t20 

Take g(X) = ех and k =e", identify (е » e") - (X >с}. 

Deduction. Let X,, X» ..., X, be i.i.d. variates with common m.g.f. M(t) and 5, = ÈX; 
Then P{S,>ns}<e"" [M(D]', V 5>0, V t»0. 


M(t:S,)= M(t: X, +...+X,)=[M(t: X)]" = М” (г). Take X = S, c-nsin Bernsteins inequality. 
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Chernoff Bound : P{X>c}<mine™“ E(e"), ae 5 
t20 


That is, P{X 2 cj can be no larger than the smallest value of the R.H.S. 
Note. Chernoff Bound (1) frequently proves tighter than the Chebyshev's inequality bound. 
Observation. Let P(X < 0) = О and E(X) = р < o. Show that 
(i) P(X»2p«sU2. Du sur) > 1 — (1/5, Vv. ¢ Si. 
(i) Let g(X) = X and k = 2и. Then Chebyshev-Bienayme inequality : 
P[g(X) 2k] XE[g(X)]/k provides P(X > 2p) < p/2p = 1/2. 
(ii) Take g(X) = X, k = pt ; the above in-equality provides : 
СЕТЕЙ) 177 => P(X«-w)»1-(/t, V tz. 


Note. Independent proofs of (i) and (ii) are instructive. Try them. 


10-13. Cauchy-Schwarz's Inequality. (C-S Inequality) 
For random variables X, Y if E(X’). E(Y?) < o, then 


IE(XY)? x E(X?).E (Y?) « A) 


Equality holds iff Y = mX with probability 1, where m is some constant. 
Proof. Write E(X^) = a, E(XY) = b, E(Y’) = c. Consider 
eee A EE( X? -2iXY + Y?) = ГЕ(Х?) -2:£E(XY) EQ?) 
= at? -2bt * c. 

Obviously, Q(t) > 0, non-negative quadratic form and hence its discriminant A = 4(p^ — ac) 
is non-positive. Thus, 

A<0 = Б <ac, ie. IE(XY) < Е(Х?) E’). 
Now by Chebyshevs inequality, if E(Z) = 0, then 

PII ZI« ул} 1 (n 2 1) 

Let n — oo, and use continuity property of probab. measure to get 


lim Р\71<1/л}= Рт 141< ИЛЕ P(Z=0) 


Thus P{Z=0} = 1. with Z = Y — tX, we get P(Y = iX) = 1. 
In this case, 1 E(XY) P = E(X’). EY). 
Note 1. Take Y = 1, replace X by | X ~ и |; then (1) provides 

[E| X - ul < E(X- p)! = M.a.D.<S.D. 


1 


Note 2. Measuring X, Y from their means. Schwarz’s inequality (1) provides С, $9,9,. 


Cor. Triangle Inequality Н [E(X Y]? < E(X?’ + [EY]. 
Proof. We observe that : (X + У)? <IXI(IX+YI+IVIUX+¥1) 


Ф 


P E(X +Y} «El XIQX Y D]- EU Y OX Y D] AA) 
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Apply Schwarz inequality : E(UV) « [E(U? )E(V 2)1'? to each of the two terms in (A) to get 
/2 
E[(X + Y] < (E(x?) E(X  YY ]? + (EQ EX + У) ^ 


Dividing throughout by [E(X + Y)?]? #0, we get the stated result. 


Example : Let X,, X,, ..., X,, be i.i.d. variates and k is any real number. Set X, + X, +... 
+ X, = 5. Show that 


< 


San k S) > 1, -Ti 
n 


А Say _ 
2n 2 


Solution. Let Y = (S,/n) and Z = (5,, — S,)/n. If event in (1) is B (say), then 


В = {|(¥+Z)/2-ks|y-k|}= {IY -k)+(Z-k)I s21Y - «1j 
= lIZ-kI«lY к) 
Р(В) = PZ 11у - kl d) ek) 
This follows from the fact that X, аге i.i.d. variates and 
P{X;>X,} 2 (2) 


In fact, the inequality in (2) is true bu for discrete variates P{X, = X,} > 0, and for 
continuous variates, Pix, = X,} = 


10-20. Kolmogorov’s Inequality 


Let X4 XA us, К. be n independent centred variates and Var боа c? «o,lzkzn. 


Write S, = X, + X, +... + X,. Then for all c > 0, 


pf max 15,1» c] < E 2 (1) 


Isk 
Proof. Introduce the r.v. N by the following definition : 
N= min, {К<} $; c^; N=nif S; «c?, V 1< k X n. Explicity : 
N= lif X?>c’, N=2if X? «c^ and $2 >с?, 
Na RAP BE TIE, SETS, PESO N=nif S; <с?, 1<k<n-l. 


We apply Markov's inequality to the identical events { max (5) >с = {5% » c^] to get 


Р{тах 82 > с^} = PIS; > C) «E(S5)/c?. rok) 


Note that Е(5,)* = Var$,- 2 War(X,)= 5 oj 463) 
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We find that (1) flows from (2) if E (S; ) < EU ) . For this purpose, we use conditioning on N. 


E(S;IN-n) = Е (55 IN = п), and fork <n, 


EIN =k) = EMS +S,- INzn)-E(SIN- ) -2b(G, .S,_,)IN=k} +E(S,_, |N=K) ...(4) 
Now, the event {N = k} contain information about Х|, = X,, since the event implies 

2 2 iiti 2 
that X; €c,., Sk-1 SC, Sk >с”. However, this event says nothing about the values of 


E», X. c E. Since all the variates are independent, it follows that S, and 5, , 
o + X, remain conditionally independent given {N = k}. Hence 


E((S,.S,..) = K)  E(IS,IN = kK). E(S, ,IN=k}=E(S,1N=K)E(S,_,) =0 
since E(S,_,) = Е(Х,, 1) +...+Е(Х,) =0, (centred variates). Thus (4) reduces to 
Е(521№= 0) >Е (521 = к) = E{(S2)IN=k} 
It follows that for all values of №, Е (57 |N)>E(S,1N). By Double-E Rule 
ЕИ ЮЕЕ (521) =. Е(52)>Е (52) 1.е:Е(52)<Е (52) = Ус. ...(5) 
Substituting (5) in (2) the result (1) follows at once. 


Comments. (i) Take п = 1, then P{| X - p |> c) € o/c’. [Chebyshev's inequality] | ...(6) 
(ii) Kolmogorov's inequality is much stronger than Chebyshev’s inequality. For 


a o? n n 
PIS, I»c) < à 2 (Chebyshev's inequality), a >с 2. 
= к=] k=l 


acis 


(Kolmogorov inequality). 


C 
The set U (15, 1» c) is much larger than the set [ES >с}. 


10-21. Worked-out Problems 


Example 1. Two dice are thrown once. If X is the sum of the numbers showing up, prove 
that P{ | X — 7 | > 3} < 35/54, and compare this value with the exact probability. 


Solution. If X,, X, are face values of two dice, then 
E(X,) = (1/6 (1424...4 6)=7/2; Е(Х2) = 0/6) (P +2? +... + 6°) =91/6, 
Var (X,) = (91/6) — (49/4) = 35/12 

Now X= x +X,,E(X)=2E(X,)=7, Var(X) = 2 Var(X,) = 35/6. 

From Chebyshev's inequality P(IX - ul2 c) < (с> /c^), we get 
nde P(1X —7123) € 35/54, [02 /c? = 35/54,c = 3]; 

— Exact evaluation : Now let p = P{IX – 71< 3) = P(4 < X <10) = p, + р +... + Po eA E 

p, = P(S,) = (6-1k-71)/36 k= а га Т2 
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= 6/36, p, = 5/36, p, = 4/36. 


р; = 4/36, рк = 5/36, p; 
р{1Х- 712 3} is the actual value, 


Hence p = 2/3, q = 1/3 [from (1)]. Thus q = 1/3 = 


a wide-apart result. 


Example 2. Obtain Chebyshev's Inequality in the form : p = P(IX, - р1<) 21 8. 


(a) How large a sample must be taken in order that you are 99% certain that X is 


within 0/2 of и? 
(b) How large a sample must be taken in orde 


0.95 that X, will lie within 0.5 of p ? p is unknown and o = 1. 
2217 [n= 10] 


r that the probability will be at least 


(c) How large n is to be so that P(IX, -p1<1}> 09, when o 

Solution. By Chebyshev's inequality : p = P(IX, -yl«s)z1-[E(X, -p/e]-1- (o* / ne’) 
p21-(o!/ng?)21-8 if 68-0?^/ng or n-6?/6g.. 

Note. If we want p to equal at least A, we must put A = 1 - (o? / ng?), from which we 


can solve for n, giving n = 62 /(1- А). 
(a) Неге = = 0/2, A = 0.99. Thus л = 400. (b) Here A = 0.95, с? = i, == 0.5, n = 80. 


Example 3. Total-E Rule. Define E(X | A). Let A,, A,, ..., A, be a partition of 5 and В 
an arbitrary event of S. Show that 


E(X) = P(A)E(XIA) + P(A) E(X1A,)+...+ P(A,) E(X1A,) EL) 
Deduce the following : 
(a) Р(В) = P(A) P(BIA,) + P(A) PB VA y... Р(А ) PUB A). 245 
(b) P(IX-cl» aJ xE(IX—cl')/a'. "TE 
(c) Var (X) = 0. ШОР = aca p ...(4) 
Solution. Here І, is indicator variable of event А, I, = indicator of event A, 1 <j < n- 
Definition. | E(X1 A) = Е(ХІ,)/Е(Т,) = Е(ХІ,)/Р(А) i 6.45) 


E(X) 


E(XI,) = E(XI, +1, € € 1,)) EL + ХІ, +... > ХІ) 
E(X1,) -E(XI) +...+Е(ХІ,) [by Lin E] 


P(A, )E(X1A,) + Р(А,)Е(Х1А,) +... + P(4,)E(XIA,). [by (5)] 
Deductions. (а) Let X = I5, then (1) yields 
P(B) = ХР(А,)Е(Т,1А;) = EF(A)) P(BIA,), 


(b) Let X > О and define A = (X <a}, A={X >a}. Now for events A, A formula (1) provides 
E(X) = E(X1A) P(A) +E(X1A) P(A) 
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E(X) = E(X" IX <a) P(X <a) +E(X" |X >а) P(X » a) 3 E(X | X > a) Р(Х >а). 
since E(X' 1X » a) >а", this inequality yields 
E(X')»a Р(Х>а) = P{X>a}<E(X')/a’ [Markov Inequality] 
Replace X by | X —c | to get result (3). 
Note. Take c = E(X) = p, r= 2 to get result P(1X -ul»a) «o? /а? [Chebyshev's Inequality] 


(c) {X=p} = П ju-t<xcped L- N ix - uet (Draw Figure) 


n=| 


Let D = (X = p} and D, = { IX- p |< I/n). Observe that (D,) monotonically decreases 
to D. Hence by Continuity of Probability measure 


FO) = lim P(D,). ...(7) 
Ву Chebyshev’s Inequality : 
P(D,,) = P{\X —pl<1/n}2=1-n’o* => P(D,)=1, (иѕес =0), 
Substituting in (6) we get P(D) = 1 > P{X = р} = 1, whenever o = 0. 
Conversely, Var (X) = E(X- р)? =0.1=0,at X =p with probability 1. 


Problems with Solutions Provided at the End of the Text 
1*. (i) A variate X has mean 50 and variance 100. Assess the following : 
ILU = 50) 2415)... (b), P(X 2,65) €. P(X < 35), (c) P(1 X – 501 < 20), 
ID P0 « X < 70), (e) Values of t that make P( | X – 5012 0) € 0.01. 
2*. Let Z,, Z,.., Z, be arbitrary but standardized variates. Show that 


P{\Z,\<tvVn,1<k<nj21-(1/t’), V t>0. 
3*. Let Х|, X», ..., X, be iid. variates with E(X7) « o. 


Let Z, = [6/n(n+ 1) (2п + D] УКХ, ,(1< k € n). Show that Z, —— E(X,). 
4*. If X is a variate such that E(X) = 3, E(X’) = 13, show that 
(дк Xue io 2425. 
BP А sample of size n is drawn from a population whose mean is 5 and S.D. is 1. 
Prove that P(IX — 51«0.001] 2 1 — (10° / n). 


6*. A discrete variate X is specified by /(-а) = f(a) = 1/8, f(0) = 3/4. Compute 
P( | Х| 2 26) and compare it with Chebyshev's inequality bound. 


7*. Evaluate P( | X — py | > 20,), for the discrete variate with density 


Е F(X) = (178) у(х) + 6/8) (х) +0178) 14,09. 
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8*. Does there exist a variate X for which P{py - 206€ X < uy +20} = 0.6. 


9*. In sampling without replacement, what sample size n will ensure that the sample 
mean differs at most from the population mean with 5476 with probability greater 
than or equal to 90%. Assume the coefficient of variation is equal to 1/10. 


10*. Box k contains one defective and k non-defective balls k = 1, 2, ... A ball is drawn 
at random from each box. Let X, = 1 if ball from kth box is defective and X, = 0, 


otherwise. Let 
5 = X, * X, +... + X,. Show that as n > о, Р{ 15 /íÁnnl-11«&]) = 1....(1) 


10-22. Gauss' or Camp-Meidell Inequality 


Suppose, X is a unimodal variate with mode x, and s = (р — xg)/o is Pearson's measure 
of skewness. If > | s |, and X* = (X — р)/с, then 


P(IX*I2 k) «4(12 $2)/9(k -1s0)? { [Extreme value probability theorem] 


When s = 0, p = хо, then P{ | X* | > k} < 4/9 k. 
Gauss’ Lemma. If g(y) is strictly decreasing for y > 0, then for any A > 0, show that 


© 4 EO 5 ә 
vf gody s С], V80) d. lie. A? PIY > A) «(4/9 EQ?)]. ...(1) 
Proof. (1) In the special case, when g(y) = const., say g(y) = A, for 0 < yc; g(y) = 0 
for y > c, we have Ф(А) = № | g(y) dy = AX (c — А). 


Ф'(А) = AQcX – 347), Ф”(А) = AQc- 6А); 9'()20 = X -2c/3. 
Thus, @(A) is maximized for A = 2c/3 and max @(A) = 4Ас'/27. The R.H.S. in (1) also 
integrates to 4Ac 3/27. Thus (1) holds. 
(ii) In the general case, when (у) = const. we define the function 


hy) = gy) O<y<A+a, h(y)=Ofor y>A+a. 


From Bonnet’s 2nd Mean value Theorem of Integral Calculus : 


[vod = фа) f; vG) dx [oxy 1,5 e(a 6)] 

f «ау = gf" dy ag0). (2) 
Tu а f° уо) ау< |2) yh 2 

Now X hody s (53), 7004955), Y ho)dy [By Part (0] ..» 
In (3), LHS. = Wf" e(A)dy=an? в) - X |" go) dy [by (2)] 
№ [800 dy S E J£» nay «(3 ) f уг20) а, (А0) < 001. 
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, б : " zi Guy 
proof to Gauss’ Inequality. Use this lemma in exercise No. 19 of set of exercises 10(b). 


Example : Find Pearson's measure of skewness for a variate X defined by f(x) = е", 
0< x < o. Use Chebyshev's inequ 


pri xX-112 5}. 


ality or otherwise to find an upper bound for- 


Solution. uj = Е(Х') = |, x e*dxeT(r«)-rl рер =], ш =2, 62 =2-1=1. 


since f(0) = 1, and 2» = 0, it follows that X = 0 is the unique modal value. Clearly the 
modal value in this instance is not very satisfactory measure of the central tendency. Now 


ленае реа ak ЕА 


Tm 1. 


Sy 
By Chebyshev’s Inequality : P{1X1>b}<1b => P(IX—11>5)<1/25. 
Using extreme-value probability theorem; 

Р{\Х — 11> 5)< [4(1+1)/9(5 – 1)?]= 1/18. 


Exercise 10(a) 


1. Variate X takes the values —1, 1, 3, 5 with associated probabilities LIN Show p = 
P(1X-3121) = 5/6 directly and find an upper bound to p by using Chebyshev’s inequality. 
[Ans. 16/3] 


2. Let E(X) = 11, Var (X) = 2. Use Chebyshev's inequality to estimate from below 
PIX = 92 TOS, 12; 137. 


3. Variate X takes the values —8, —6, 0, 6, 1 with associated probability 5,2, 72,7 т. Obtain 


the upper limit for P( | X — 612 2} and compare this value with actual probability. 
4. (a) Let X have the p.d.f. fix) = 1/243, 3€ x x 43; fx) = 0, otherwise. Show that 
P((X — р) > 30/2} = 0.134 and compare it with the upper bound obtained by Chebyshev's 


Inequality. [Ans. 0.444] 
(b) Let X ~ U (-a, a). Compare P{ | X12 1.5 с} with upper bound supplied by Chebyshev's 
Inequality. 


(c) Let fix) = 1,0<x<1;f(x) = 0, otherwise. Obtain the lower bound to P(I X — ixl 143) 
and compare it with exact value. 
5. Variate X has p.d.f. f(x) =e", x > 0. Use Chebyshev's inequality to show that P(1X- 11»2) < 1 


and show that the actual probability is Pa 
6. Variate X has p.d.f. f(x) = 2x/a^, a > 0, 0 < x < a. Show that P( 1X - 
it with upper bound. | n 
* If X is the number scored in a throw of a fair die, show that the Chebyshev's inequality gives 
PIX. ul > 2.5) < 0.47, while the actual probability is zero. TUS 
A discrete variate X can assume only the values х = 1, 2, 3, ... with probability 2 Pee gn 
Chebyshev's inequality gives P{ 1X - 2 | > 2] < 1/2, while the actual probability 15 1/79. 


u 12 a/3) = 1/9 and compare 


2с 
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9, 


10. 


(a) A variate X has the p.m.f. f(1) =f 1) = p, KO) = бр. Show that there is a value of 6, « | 
P(IX-ylz6)z в7/87, so that, in general, the bound given by Chebyshev's inequality cannot 
[Ans. д = |] 


be improved. 
(b) Let f(-2) = (2) = 2/9, KO) = 5/9. Compute P(IX -ul> 30/2} and comment on the result 
(a) Use Chebyshev's inequality to prove that if Var (X) = 0, then P(X =p) = | 

(b) Does there exist a variate X for which P {p —3o € X € u + 30} = 077. 


(a) Let E(X) = р, Var (X) = o^. If at least 99% of the values of X fall within k standard deviations 
from the mean, find k. 

(b) For the Pareto law : f(x) = 24x ^, xZ 2, graph the function $(6) = P{ IX- р> 6] and compare 
it with the upper bound supplied by Chebyshev's inequality. 


Show that P{X22p}<4, if P(X <0)=0. 


. Let u = с = Ө (say). Show that a lower bound for P{-30 < X < 50} is 15/16. 
- Let M(t), Itl « h, be the m.g.f. of a variate X. Show that 


P(X2a)se"M(t), O<t<h; P(X<a)<e“M(t),-h<t<0. 
If M(t) = (е — &'y/2t, t real, deduce that P(X > 1) = 0 and P(X € -1) =0. 


. Establish P(IX —pl>k}<E[(X - u)"]/k?"; р=Е(Х), k2 0. 
. If EC) < o and if P(1 X — ul « a) = p, where a and p are given, find a lower bound to Var (X). 
‚ Let X;, X», ..., X, be (possibly dependent) variates such that E(X)) = p and Var (X;) = o. 121,2, ..., 


n. Prove that, for any positive numbers d,, dy, ..., dy P(1X;- ц1<4, 1 «i$ n] 21— Xd; o;. 


» X,,X,,...,X, are i.i.d variates with P(X,= 1) 2 p, P(X;=0)=q,p+q=1,0<q < 1. Let W, =(X,/2) 


B (X,/27) + (X,/2°) Toc (X,/2") and suppose that У, — Was n — о. Now prove or disprove : 
(a) P(W, < 1/2) = 1,n«o (b) P(W,, < 1/2)=q 
(с) P[W, <(1/2)"*'J=q"*!. 


10-30. Frechet Inequality 
Let a and b be any two positive numbers and let for a г.у. X, E(X) = р and Var (X) = o°. Then 


_1+[(b-a)/2/7 


T: 
[(b + a) / 2 ро 


р = Р{ір-ас<Х<р+рс)>1 


Proof. |t pays to use standardization. Let Z = (X — u)/o. Then E(Z) = 0 and Var Z = 1. Now 


P 


= Р{р-ас<Х<р+рс) = P(-a«Z <Б), [Subtract (b — a)/2, from all nos.] 


P(-i(a*b)«[Z + (b-a)] < $ (a * b)) 

= P(IZ-i(b-a)l«i(a-b)) 

> -(EIZ-i0-2y/[D (a D). by Biename-Chebyshev's Inequality 
E(Z-i(b-a) = E(Z)-(b-a)E(Z)*i(b-afy2141(b-ay 


p = 1-{1+1(Ь-а)?}/1(а+Ь)?. 
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Comments. The standardized variate X* is independent of the units in which X is measured. 
Let X, = aX + b, then 


xs = eX *b-E(aX«b) afX -E(X)] _ X- hy 


— ET a мс УЛ uu X xw 
| Var (aX + b) a(o y) Sy 


10-31. Strong Upper Bounds 
Suppose g(X) = (X - р)“, E [g(X)] = u,, then by 10-30 (1), using k = г 
| P{1X-pl2t} s (ur). (A) 


This will give a stronger upper bound (smaller in numerical value) than that supplied 
by Chebyshev’s inequality for those cases, in which 


Б) o rs Iu ul". [m = с^] 262) 


From (2), it follows that if a sufficiently large t is used, then (1) gives a smaller upper 
bound than that given by Chebyshev’s inequality. This is natural, because large values 
of t imply a concern with large deviations of X from р, and large deviations are better 
characterized by p, rather than by џ,. 


Now suppose that g(X) = [(X — р)? – p]? ; Elg(X)] = н, - p7 and 810-30 (i) implies 
BONG 3523 nip et < Gy - iic. 7.03) 

Two observations emerge from (3) : 

(i) Since probability measure is non-negative, p, -u 29 => B21. 


(ii) If р, — u$ is sufficiently small, then there will be only a very small probability that 


(X - uy will be very far from џ,. If p, is sufficiently large, then (X – TN being close to p, 
implies that X cannot be close to u. Such a behaviour is characteristic of bimodal distributions. 


The Chernoff Bound 

Let Х|, X, ..., X, be a sequence of i.i.d. variates with m.g.f M(t) and c.g.f. K(r) 
ie. K(r)- бп M(t) or M(t) = exp (K(t)). Now form the sum 

ВЕ ХОХ. 


п 


Then Ее“) = Eje“ * -**9] = [E(e*)]" =[M(t)]" zelo (1) 
Let A be a real number and define events A and B by 
= {S,>A}=fe™ 26") t>0, B={S, <A} = [е 2e"), 1«0. 


If I, and /, are the indicators of events A and B, then 


еб 2e" 1, (t20), e "ее 1 (50) otal 
We can verify (2) just by taking logarithms. Now expectations of (2) and use of (1) yield 
таз: ке, r0, РОВ) eNO", 150 ...(3) 


The value of t that minimizes, the R.H. S of (3) is ^ value of т that minimizes 


8(t) = nK(t) — At. So by differentiation g'(/) = nK'(t) - 
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es 


1 T s (3) ei 
g"(t) - nK" (t) » 0, (Var (X) « 0). So g'(t) = 0 Ей nK (to) = А. Thus ( ) 81v 


PiS 2nK'()) < е" 07), „>0 | 
Жн 0 


lA 


PIS <nK'(t,)} < e ^ FF. gp <0 ...(4) 
n 7 0 = 


Relation (4) gives Chernoff Bounds. 
Illustration. Chernoff Bounds for N(0, 1). 


Here К) = nM(t)=0?/2, п=1, A=K'(t)=t, — [K'(r9) = 0 = mean] 
P{X2A} € 4, 420;  PIXSA} < е2, ASO. 


10-40. Cantelli Inequality 
Let X be a г.у. with E(X) = 0 and Var (X) = o^ < ©. Then 
2 
(а) P(X«t) 2 г/с? + Г), г> 0. (Б) Р(Х <1} oo? +1), г< 0. 


Proof. (a) Since 0 = E(X) = rr xdF(x), it follows that 
^d ж (x- n dFG) -|f'. +]. Ја -дағо)г> ['. (x а(х), [2nd integral > 0] 


ts |0 х) ао) = f, 6-3) G)dFQ). UG) S lif х<1,1,(х)= О, x гп 
or ts E[(t- X).1,(X)] 
By squaring both sides and using Cauchy-Schwarz inequality [E (UV)? < E(U? УЕ(У?)], 
we get 
2 x([E(r- X).L,G) <E¢- X .ELP OO] S E? — 21x + X?). P(X « 1) 
= [P - HEX) X EQ. Р(Х <= + с?) Р(Х <). (E(x) - 0, E(x?) - g?] 


ie. P(X <t)20?/(t? +с?). [Equivalently : Р(Х >гу<в?/ (в? + "n. 
(b) When t < 0, then — г> 0, and for any variate Y, part (a) supplies 


P(Y2-1) < oy/(0, +) = P{X<t} < с2 /(62 422), [Put LT TN <0, 


General Case. If E(X) = p # 0, then letting Z= X-u, E(zj = 2 


0; 02 =0%, we get 


PERS) m P(E ete eta РУТИН 


P{X <t} 


PAZ Ste a ser Merete uy) phy, 
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41. Worked-out Problems 


mpie 1. If Үз 7 (4, /с*) -3 is known, show that it is possible to improve 
yyshev's inequality in the form 


Ф: 2 Dd 
BEEN ulko) s — 12t i  . шо &. 

B. Yet (0 I ^ iu cato elo? 

P TP А 

ET any positive real number greater than 1. 


For any variate Y, we know by Cantelli inequality : 


P(Y21]) < 67/(162) СА 


"x 


i 1)/ (К? — D, k >1, where Z = (X — u)/ o. Now E(Z)) - LLE(Z^) = р, / o* and so 


(2?) [EZ5-E'Z5)Qu/6*)-1. ү; +2 0 
EN SUL ord V ат) 


т con ES (3) 
E24 1) 


= — ny: i 
PZ? 2k?) = PAZ: - 1220). 


д ийа" ЭШЕ > dese e ur 
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E ution. Let 


чю], р X < оо, 


1 
Дх) = ое 207 


(i) Use Chebyshev’s inequality to establish P(X? zt) Qi +o°)/t. 


Example 2. Continuous Bimodal Distrib 


4 Жү 2 
(ii) Obtain the stronger bounds : Р{ІХ? ду? _с21>1}< (2с * 40 )/г. 
Solution. Firstly to find u, ме find m.g.f. of f. 


M(t) = „(вту [. e owls Lg 0*0 79 ] dy 


zE +E(e”)], [X ~ Ми, 0), ¥~M(- 07)] 


[e^ tio" 2 4 g "t enm A ael] (eM + "|е oF !2 cosh (ut) 


2.2 444 2.2 4,4 
b gu И: pt we 
= dum. з B 214 - c zT * Ji + s T) 


Now р’, = coeff. of t/r ! in (1). As р" = 0, simple and central moments coincide. 


uj = y^-c0?, p, =“ +607 y? + Зс“. 
(i) P(g(X) <t} < Efg(X)]/t. [810-30 (1)]. Take g(X) = X, E(X^) =p, the result follows. 
(ii) РИХ – ш) – 12:7} < (p4 = 5) 702 [$10-32(3)] 
Here p,- p? = 26* + 40? y^, р' = Е(Х); the result follows. 
Problems with Solutions Provided at the End of the Text 
1*. If a positive variate X has mean р and variance o°, show that 
P(X21). S EKX -c) Mc, 150, V сьо 
If р = 0, deduce that P(X 2 t) 6? / (0? + 12). 


2*. Let X,, X, ... be a sequence of r.v.s and let pomis1 With dp, = 1. 


ISiso, [o(X,)-6,] 
= + X, and Var (X) = с. Show that 
bui, 


Let X be a r.v. 
r.v. whose all moments are finite. If их and n are positive integers 


ЕХ рс [EO XI") EQ x pe Me 


Hence show that the curve g(n) = (п SEFT ep M in the plane of & and !' 


Prove that : с(Ур, Х,) < Ip; o; < (Ep, o2? 
1 1 е 
3*. Let Xj, ..., X, Бел variates, S, = X, + YT 


Var ($/n) < Yo?/n, (1-1,2, 


§10-51. Jensen’s Inequality on Convex Function 3 57 


10-50. Definition of a Convex Function 


Let ф:К К. The function @ is called convex iff 


ф(х + (1-A)y) < A(x) + 1- à)9(y)5; А> 0 апа x, y ER. 
Note. A sufficient condition for @ to be convex is that ọ”(x) > 0. Geometrically, the 
graph y = ф(х) lies on or above any of its tangents. 
10-51. Jensen’s Inequality on Convex Function 
If ọ is a convex function, X a random variable with finite mean ui = ECX), then 
Е[Ф(Х)] > o[E(X)]. 

Proof. Taylor's series for ф(х) about р = E(X), with remainder after two terms is 

Ф(х) = e(U-*G - n) e'Q) +E G 8)? o"(5) 
where € is some value between x and p. Since Q"(£)20 as @ is convex, we get 
O(x) 2 Ф(и) + ọ'(u) (x – н), true for all x. Hence, randomizing 

O(X) > Фф(р) + (Хр) ọ'(p). 
Taking expectations and using E(X — и) = 0 yields 

Е[Ф(Х)] > ф(р) + o'Q)E(X - п) = (н) > E[o(X) 2 Ф[Е(Х)]. 

Cor. If г.у. X has finite mean and y(X) is a concave function then E[v(X)] € v[E(X)]. 


Proof. The result follows by observing that —y is a convex function. 
Illustrations : 


1. ф(х) = x. Q"(x) = 2 > 0, hence ф is convex. It follows that 


EQ?) > (E(x)? => Var()20. 
2. Q(x) = 1/x (Rect. Hyperbola), ф”(х) = (2/x^) » 0, for x » 0. Hence 


Е(1/Х) > 1/E(X), for all X > 0. 
3. ф(х) = п x, x > 0. Q"(x) = 1/х2 < 0, thus (-Un х) is convex function. Hence 


Eni (X)] = n IEC] X»0 
4. AM/GM Inequality : From Jenson's inequality, applied to —n X, we get 
E[én X] < dn [EGO] > Ур, 0n x; < Un (Ур, x) 
Where SIX ex) 1= 1,2, «1, Take pi. 1/п (equi-probable case) 


on TI M &inzp, x, => Xp, X; ce fix” 


Le, 


5. 


(x) +...4x,)/n >(х„х,...х„)'" => AM>GM. 
Ф(х) = е", ф"(х) = 2е* 20, V x. Hence 


E(e*) > e"> My()ze", [p-E(QOI]. 


ЖЕЕ 
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10-52. Lyapounov Inequality 
Let E(1XI^) «oo. Then for arbitrary а, b,0<asb. 


1/р 


[E(1 X I^ )] ^ < [E( X )] . | 
Proof. We note that, for А > 1, g0) = (Y^, y = 0 is convex. Hence by Jensen's Inequality : 
E(Y?] 2 IEQ)P. Let Y 21 X, A = b/a 2 1, then 
Exit)" < EQX^) = [ЕХ] « [E1 X l^ ]^. 
Cor. If X > 0, then 
EQ) < [EX]? < [EX]? s [EX] <... 
3 
Example : If X and Y are i.i.d. variates, with E(X) = О and E( | X Г) < ©, then 
E(IX - YD! <4E(1X 1)". 
Solution. IX -YP AX -YVX - Y <(IX1+1Y1) QC + Y - 2XY) 
= |X abb ЕБ ТАЙМА 1 2XY . 1X I 


Since ЕІХ = EIYP,E(XY .1 XI) -E() .E(X .1 X1) = 0, etc. 
E(IX -YP «2EIXP + 2E(X?)EIYI-2EI XP + 2E(X?) EI XI « 4E (I X^ ) 
[-EIXIxE'^ 1X31, E(X?) < [EI XP ^, by Cor. 0810-52] 
10-60. Hélder’s Inequality 
Let p 2 1, q 2 1, such that po + qs = ], and X, Y be positive variates. Then 
E(XY) < [EXP E(x)", ae) 
Proof. The function Q(x) = Un x, x > 0 is concave. That is, for each КЫП s A < 1, 
A Un х+(1—))%п^у< (п [Ах + (1— Уу]. 
By antilogarithm : x^. y'~* < Ах  (1— X) y. (i) 
Put A= p, 1-А=4, х= X' IE(XP), y- Y! /E(Y*), then (i) yields 
X T X? 
—r a eus IT : 
[xy tem^ ^ "Ea * Ea: ii 
We take expected value of both sides of (ii), clear the fractions and instantly obtain (1). 
Cor. 2 2 2 e | 
or. [Е(ХҮ)] <Е(Х?).Е(Ү?). (p=q=2) [Cauchy-Schwarz Inequality]. 


10-61. Minkowski’s Inequality 


For every integer k 2 1, and any г.у. X and Y with E(x* 
and Y belong to L space : a generalized space] (0) « = Еу“ ) < o.[This means Х 


$10-70. Gurlands’ Inequality _ dh Б 359 


УГЕ ЕТ) Ely E, oL) 
Proof. For k = 1, result (1) is trivially true. Now 


IX «Y = НУК IxeyYIsiXAoYV ^ ХІУ) 
EIX*«YY* < EIX«YI*! ХЕХЕ У! ГУ 


«(gixi^ "(ЕХ)" + [ELX У js (E | y I)" [by Holders inequality] ...(2) 


where 7 +57 — 1, and hence (К — 1) s =k. Dividing both sides of (2) by (EI X + Y ra» 


we obtain 
[EX « Y  '-*? «(EI X *)"* +i). ps! = kc] 
This is the result (1). 


10-70. Gurlands’ Inequality 


Let ф апа y be continuous monotonic functions of a г.у. X which are both non-decreasing 
(or both non-increasing) and for which q(X) > 0, w(X) > 0. If expectations exist, then 


E[p(X). y(X)] > E[o(X)] .E[9(X)] (1) 
If @ is non-decreasing and y non-increasing or vice versa, then 
E[p(X). w(X)] < E[g(X)]. E[o(X)] ...(2) 


Proof. Let ф and wy be both non-decreasing, then for x and y in their domain of definitions, 
y2x > Oy) = ф(х) i.e. ф(х) 2 0. Similarly, y 2 x > wy) – ф(х) = 0 ; hence 

[o(y) = €G)] bv) — wG)] 2 0. (1) 
If ф and y both decrease, then for y 2 x, we get ф(у) < @(x), wy) < (x) and these give 
(y) – ф(х) < 0, w(y) – ф(х) € 0, which once again provide (i). 
Hence if of, wt or фу, wi, we always obtain for random variables X and Y 

lY) - p(X) Ty) - w(X)] 2 0. (A) 
Let X and Y be i.i.d. variates then from (A), taking expectations 
Elo) v(Y) + ФОХ) y(X) – e(X)w(Y) - Ф(У) w(X)} 2 0 

ог  E(o(Y) y(Y)] + Ele(X) v(Y)] - Ele Ely (Y) - Elo) Ely (X) 2 0] (B) 
Further: E[o(Y) y] = E[oQO vOO]. [^ X, Y are i.i.d] 
Making substitutions into (B), cancelling factor 2, we get 

E[o(X) v(X)] = E[oQO] Ely] (1) 
This establishes the result (1). The result (2) follows by noting that if ФТ yl or Ф, 
YI, then instead of (A) we shall have 


[Ф(У) - o0] iy) - y(X)] «0 TS 
Which leads to (2), using the i.i.d nature of X, Y. 


е 
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Extension. If Q,, 9, @, are continuous monotone functions of a variate X which 
E 2› сө n а | 
are all non-decreasing (non-increasing) and for which ф(Х) 2 0, i = 1, 2, ..., n, then 


Elo, (X). 95 (X) ... 9, (X)] > Ele, CO]. E[o; Q0]... Elo, OO]. 
Some Illustrations 
(i) ЕХ") €EQC) .E(X^), r» 0. Take ф(Х) = X, Y(X) = X" in (2). 
(ii) Take @(X) = w(X) = (X — и)”, then (1) provides E(X – и)“ > [E(X - NT = p, >21. 
(ili) Take Ф(Х) = y(X) = | X- u I ; then (1) provides 
E((X – 1] 2 [E(IX - n? > c2 2[5()] = S.D. + М.Р. 
(iv) Take @(X)= X*,w(X) = XP in (1) or (2) to get 
E(X**)2E(X*)E(XP),0,8»0; E(X**9) «E(X*) E(XP) a «0. 
In particular, E(X°) «E(X) E(1/ X) 2 E(X) 21/E(X^)). 
ЕСК у E(X?)E(X ^y: 2 E(X?) STI E(C?). 
In general : ЕСК) ЖАПЕК" унго; 3,7: 
(v) Take @(X)=e'*, y(X) 2 e^*, so that (X) y(X)2 e^*'?* Use (1) : 
E[e^*?*] En Be => ME +2: Х)> Mt: X) M(t: X). 
Exercise 10(b) 


1. Let E(X) =.0; and E(x^ = ц, for a variate X. Using the relation E(AX^ + ВХ” + СЖ)? >0, 
establish 


Ho, На+ь Hate 
Wi ge on Urs е: 
Heta Hep Нә, 


Hence or otherwise show that Pearson’s beta coefficients satisfy the relation В, - В, -120. 


Deduce also that B; > 


2. Show that P(IXI»a) > [E?^) - а? ]/Ь?, if|X1<b, 

3. Let X be a positive variate, E(x) = u and Var (X) = с> < о. If k is a number lying between 0 and 
1, show that P(X > ku} > (1 К) 7/E(X°). 

4. The p.d.f. f(x) of a variate Xi is symmetrical about X = 0, and has a single mode at X = 0, 
-a <x <a. Show that p,,< a 5r 1). 

5. A r.v. X takes on the values 1, 2, 3, ... and E(X) < o. Prove that : E(X) > 2 – p, E(X) > 3 - 2p, 
= p» ... where p, = P(X =k). борасын this inequality. 

6. (a) A continuous variate X > 0 has a non-increasing p.d.f. f. Show that f(x) < 2E(X)/x’, for all x > 0. 
(b) Letg(X) 0 У хапа g(X) 2 k for V x € J = Ja, b[. Show that P(X e J} x & ! E[g(X)]. 

7. C,-Inequality. If E(1X1^) < oo, E(1Yl) < оо, then 
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8. Let g(x) be non-decreasing for x > 0 and g(x) = g(—x) > 0. Show that, for every c > 0, 


10. 


11. 
12. 


13. 


14. 
15. 


16. 


Е7. 


18. 


19. 


one Elg(X)]/g(c). Further, if g is bounded, i.e. | eM aris j VIL LS 

i ——— „іе. 1 (х) < К < о, then Р{ІХІ2 > 
(E[gOO] – (с) /К. ien P{ с) 
Deduce: Р{ІХІ2с}> [Eg(X) - g(C)/g(K), if P{ 1X1 < К} =1. 


. If m.g.f. M(t) of a variate exists for every t > 0, show that 


P{tX >s + М()) <е" v s»0. 
Let X,, .... X, be completely independent variates, such that E(X ) = u; and Var (X,) = o; < 0, 
IX =y sB, 1 sin. Let further, S 7 X, X, ... X,, E(S,) = M, Var (S, )=0о?. Prove that 
Р{15,=Мі2 рс} <2 exp {-p "n T + (иВ/2с)]?, lors и (> 0) is ue: that и € o/B. Show 


further that, if pu; = 0 for all i, then dnE(e™ ) < 126? (1 " 1 Br e") 


For the positive г.у.ѕ. X and Y, show that Cov (X, Y/X) < Var (VY). 

Prove that Cov (X, Y) < Var [(X + Y)/2]. If X and Y are positive variates, then this inequality 

generalizes to : Cor (X, Y) < Var ex* + y*)/2] 2А ОЕ < 1. 

For the non-degenerate independent variates Х апа Y show that 

(i) E(X/Y) > E(X VEO), r= 1,2, ... 

(ii) Var (X/Y) 2 Var (X)/Var (Y) if E(X) = E(Y) = 0, and E(Y ') exists. 

If E(X) = 0, Var (X) = o^ and | XI € m, then pev sm. s m, r2. 

Let X be a non-negative random variables and E(X,) = М. Show that, with usual notation : 

M,» (M, ' > (M) + [M,, (М), r2 52 1. M, 2 p +0", when r2 2. 

X and Y are independent continuous variates with c.d.f.s F(x) and G(x). Define : X is 

“stochastically larger" than Y if F(t) < G(t), V t. Prove that if this i IBPIXEUJA 

(a) Let f(x) eR E p.d.f. of a continuous variate X satisfying f^ (x) > fix + 1) fix - 1). Show that 
g(r) = (u' yr pu is a decreasing function of r. 

(b) Let X > 0 with E(X) = 100. Comment on the bounds for the following : 


(i) E(x), (ii) E(V x), (iii) E@n X), (iv) е, t» 0. 

Let the p.d.f. of a variate Г є (a, b) be a decreasing function of Y. If 0 < a < Б, show that (1 +r- E 
a P(Y2 a) <p', (rV)! {a" P(Y <a) + (b *!-a *') P(Y > a)Kb — a)). Deduce Chebyshev-type 
inequalities. 

If X is a unimodal variate, deduce the followings from Lemma to $10-22, p.360. 


(i) P(IX—xI2 kx) z4/9k^ ; V k20. [Gauss’ Inequality] 

Gi) PIX ш> ko} (401+ 52) 790615 1)2), Y k>lsl. 

where x, is modal value, s = (и - xo, [Pearson's measure of skewness] and т =E(X-%)’. 
(Deductions. 12 =E(X — х2 = ВОХ) + (4-29) = EX н)? * 2 о) EX –ру+( ду) 2o? «(i x). 


t =0 +50 =(l +з?) а, 
Let f(x) be the density of the continuous r.v. X. Since x, is the only mode (maximum) of density f, 


it is necessarily decreasing for x > xy. Hence setting Y= IX - xy» 0, А = Ат in (1) yields 


242 PAX — xo l> kt) £(4/9 EQC - хо)" = P{LX — xo 12 kt} (4/92). ~(i) 
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20. 


21. 


22. 


23. 


(ii) From Bienayme" non-central inequality : P( 1X — b12 c] < [E(X — b)" J/c", using n = 2, we 
P (IX - xyl2c] < oc x08)? 1c; 
P(IX-ylzc)so?/c) > P(X-plzc)s P(UX – xy 2 c] 
[P(1X - uI2 ko] 1/2, P(IX - plz &'a) 172] 
=> P(IX-yulzko)xP(IX-ylz С) 2 
where k' = k — | s1, so that k' < k and (17 72) > (1/ K?). Thus from (1) and (2) 
P(IX -ul> kc) € P(1 X - x5 12 k'o}. 


Put kt 2 &'oi.e.k - k' 6/1 in inequality (i) to obtain 


2 2 2 2 
(i 4(1 + 
PIXE ке ee сык. 


= = А ...(4) 
9og?k?  9g^(k-Isl) 906-151) 


From (3) and (4): P(IX -plz ko] S P(IX -xo I2 Ko] < (401+ 52) 7906-1517). -G 


Show that the variance of the weighted means Ew; X; / Zw; ,1 «i € n of n independent variates 


X, is a minimum when the weights are inversely proportional to the corresponding variables. 
Also show that this minimum variance is H/n, where H is the harmonic mean of the variances 


2 . 
Go; PSU. 


Berge's Inequality. Let Z; 2 (X; — 1;)/ 6;, where p; = E(X;) and с> =Маг(Х,), i = 1, 2; Corr 


(Xj, X5) =р. Show that P{ тах (12, 1,14,1>с} < [1+ 1-р? Ee. 


(a) Show that if X isa г.у. such that P(a € X € b) = 1, then E(x) and Var (X) exist and a < E(X) < b 
and Var (X) < (b — a) /4. Prove further that p/H < (b + a) /4ab, the equality being attainable iff 
half of the frequency lies at each extreme variate- value. 


(b) Let X be adiscrete variate, P(X x) - p; 1 $i&n and let Zp, (x) =a, min, (х;) = c. Show that 


(i) cx EX) €, (ii) Var (X) < (c = by'14, (iii) Var (X) < (c – a)/(a - b). 
Let X,, X, ..., X, be independent variates : S(X,, ..., X,) and T(X,, ..., X,) being any two statistics 
which are non-decreasing functions of each component. Use Gurland's inequality and induction 
on n to show that E(ST) 2 E(S) E(T). 


Let Х|, Х,..., be i.i.d variates with P(X, > 0) = 1 and Var (in X)=o and Y, = X7. , ба X, .Show that 
Р{ехр n [E(0nY;) - £1 « Х|. X; ...Х, «expn[E(inY,) + £]) 21 (0° / ne?). 


Deduce : P(X, X4 ... X, «e^ [EQ )21- (o? / n£?). 


Pay no attention to what critics say ... a statue has never been 
set up in honour of a critic. (J Sibelius) 


знесені 


Reality leaves a lot to the imagination. (John Lenon) 


Convergence. Limiting М.С.Е 
Laws of Large Numbers 


11-10. Some Modes of Convergence in Probability Theory 


We recall that a sequence of real numbers (x,) tends to limit x, if given € > 0, we can 
find an integer n, such that 


Poets б Ye No. et) 


Now consider the sequence of the random variables (X,) : Х|, Xo =» X,. For each 
experimental outcome œ, we get a sequence of numbers 
X (0), X (0), ө X (a). aN: 1 ) 


Thus, (1) represents a family of sequences. This means we can no longer use (1) to 
define the convergence of the entire family. 


We shall now define some modes of convergence for a sequence of random variables. 


(A) Convergence in Probability or Stochastic Convergence 
Let r.v. X and sequence (X,) of random variables have common domain S. Let P be the 
prob. measure defined on S and let A, = (s : 1 X(s) - X.G) 156, 53е +5 }. 


If lim P(A,) = іт P(IX – X, [> £) = 0, V £ » О, 
noo noo 
then X, is said to converge in probability (or converge in measure) to X and we write 


X, — X. 
Note that the definition says that as n — ©, the value of X, will be arbitrarily close to 
the value X, except perhaps, at some x-values whose total probability approaches zero. 


(B) Convergence in Distribution or in Law 
Give a sequence of random variables (X,) having distribution functions (F,] respectively 


and a random variables X with distribution function F, then X, is said to converge in 
distribution (or Converge in Law) to X, iff lim F (x) = F(x) as n — oo at every point x, which 


is a continuity point of F(x). In this case, we write X, _4_, X (limit variate) or X, ——» X. 


Note that X, —4— X at almost all x. The phrase : almost all x means that F,(x) and 
F(x) differe significantly on at most à countable number of points on the real line. 
(C) Strong convergence or convergence almost surely (A.S.) 

Let r.v. X and sequence (X,) of random variables have common domain 5. 


В = (s: lim X, (s) = Х(5), 5 eS). 
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If P(B) = P(lim X, = X} = 1, then X, is said to converge to X almost surely (certainly) 
a.s. or almost everywhere except on a set of measure Zero. Very often, the definition ;; 
recorded in the form : 
lim P[Utx, - XI» el] lim a a X, - Xl» e] =0, V e>0. 

no 


n>% kən k2n 


The set U (IX, — XI» є), k2 n, is the set of all values x where X, differs from X by mor 


than є for any k > n. 
(D) Mean Convergence | ; 
Ler r.v. X and sequence (X,) of random variables have common domain S. If 
lim EfI X,- X) 20, r21 
n>% 


then (X,) is said to converge in the rth-order mean to X, and we write X, —=> X. 
(convergence in the rth mean). | 

Note. In practice we take r = 2 (quadratic mean) and obtain convergence in the mean- 
square sense (m.s.). Thus, the sequence (X,) tends to X in the m.s. sense (or limit in the 
mean : (L.L.M.) if E(I X, – X) 0 forn— oo. . 

Definition. For Х|, X,, ..., X, € L3 (X,) convergent X in I if 


lim E[1X, — XI] 20, written X, ——> X. 


noo 


Summary 


І.Х ЭХ, if given ¢ > 0, lim PIX, X1» 6) 2:0. 


2. X, — X, if lim F,(x) = F(x), V x (continuity point of F). 


з. X, => X, if P[limX, =X} =1. 


no 


4. X, —™> X, if lim E(X, - X) =0,r21. 


no 


11.11. Relation between Various Modes of Convergence 
For every constant C and (r » 1), the following results are true 


1. (X, — > K(X, — X. 2. (X, ——X)2(X, ——X) 3. (X, —9, x) (x, —2. 


4. (X, — C) e (X, — с). 5. % —9»5 0) (X, 0, fi YEQ, -O <= 


п=1 


Some implications of the modes of convergence. 


E! 


д 
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Note. We can collect the implications : 

I (A, —*— X) > (X, —— X) > (x, — x). 
(ii) (X, — 7 X) > (X, — X) => (X, — X). 
En X > (XX, "> X, if r>s21. 


КИЕ: (X, —*— X) > (X, "> X) => (x, — x). 
Solution. (i) Write Y, = X, — X, so that X, > X > Y, = 0. We further put 
EET i<e}, T= (lim Ү = 0, as n > o). 
B, = {SuplY,|<e,k2n}; B,,, ={Supl¥,l<e, k2n41), 50 В, C B,,,, В, СА, 


Because, Т = {lim y, =0}c UB, 


n=] 


P{T} = 1, by hypothesis (a.s.) and (В 7), it follows that 


i-r (Ur |= ti lim P(B,), [Monotone T Seq. of events] 


n=] 
But B, CA, > lim P(B,) < lim P(A,) which yields lim P (A,) = 1. 
Thus a.s. cgc => p-cgc. [cgc = convergence] 
(ii) Let € > 0 and x e R. Since (X - X) «1X, – Xl, soX € X, +1Х, - XI. It follows that 
D =x) = {(Xsx+8} UIX, X12 e). 
7 mL ey ee ie Sate) + PX KI 2 Е). 
Similarly, Р{Х<х- =) < P(X, xx) + Р(Х, - X12]. 
Observe that P(I X, — X | 2 €} > 0 as n — © (by hypothesis) and lim inf (..) < lim 
sup f(..), so the two preceding equalities give, on letting n — co, the conclusion 


Р{Х<х- є) = lim inf P (X, < х) < lim Sup PIX, < X] < P{X <x + ej. 


For the distribution function Fy(x) = P(X < x}, continuous at x, 
Fy (x — є) = Рух - є) = Fy(x) ase > 0. 


The continuous implications are established. 


11-12. Cauchy's Convergence Criterion (C.C.C.) 
Suppose X, — X in some sense. In general, the limit variate X is unknown, and in 
order to test for convergence, we use Cauchy's Convergence Criterion : 

LX. ~ Sik адр for n — © and any m > 0. (1) 
If limit (1) exists in ‘p’ or ‘a.e. or in ‘d’ or in rth mean sense then X, converges in the 


Corresponding sense. For example, if given є > 0, we can find n, such that 
E[IX,,., - X, ] «s, for n > ny, and any m > 0, 


then (X,) convergence in the mean square sense, etc. 
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11-20. Illustrations for Various Modes of Convergence 
(A) Case of convergence in probability 

1. Let X be any random variable and consider the sequence (X,) of random variable, 
such that X, = X + (1/n). Then P(I X, - X1» £} = P(I I/n |> £}. 


Clearly, lim P(1X, – Xl») 20, V £20 > X, —9 X. 


2. Let X be a degenerate random variable : P(X = p} = 1. Let X; (i = 1, 2, ...) be iid 
variates with common mean u and S.D. o. Introduce Z, by 


Z, 2n (X, +X, +...+X,), E(Z,)=p, Var(Z,) =o" / n. 
Then P(IZ. – іе} xo?/ng?. ^ (Chebyshev's inequality) 
Thus, lim P(IZ, — 1» е} - 0. But lim P(IZ, - Xl>e}= lim PIZ, – 1» €) = 0. 


Hence, Z, —* » X, or for this degenerecy Z, —-—) y. 
3. Let us imagine the half open unit interval (0, 1] segmented into 10 subintervals 
I, = (0, 0-1], 1, = (0-1, 0-2], ..., Го = (0-9, 1]; or segmented into 100 subintervals : 
(0-01], (0-01 0-02], ..., (0-99, 1-0] or segmented into 1000 sub-intervals, or segmented 
into an infinite number of equal subintervals. Now let X ~ U(0, 1) and consider 
X, =X + (1), where 

01) = 1 if xc(), 60)20 if хе. 
Clearly, | X, — X |= 0, except for x є (/,). Now, since X is U(0, 1) and P(x є I) = length 
of Z, hence 


Р(Х, —XI»£) = Р(х € 1,} = length 7, = lim P{I X, — -XI»g)z lim /, =0 > x, —— X. 


(B) Case of Convergence in distribution 
1. Define a variate X by P(X = 0) = 1/2 = P(X = 1). For any integer n, let variate X, be 
defined by X, = 1 + (1/л) - X. Since there is one-one correspondence between X, and 
X, we find that the density for X, is given by 

PIAS =1+(1/n)}=5=P{X, -(1/n)) 


The distribution function F,(x) and F(x) are shown as under : 
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As п — 9o, We see that F(x) — F(x) at all points x except at the point x = 0 and x = 1. 
Thus X, — X. 
2. Define variates X,, (n = 1, 2, ...) such that Fx) e n, x0, FE.(x)50, x $0. 
We assume that X, — А as n — co. If r.v. X is such that F(x) 21-6 ",x»0, F(x) =0, x <0, 
then we have X, d, X. 
(C) Case of convergence almost surely 
1. Consider a sequence (X,) of random variables with 

P{X, =1/n}=1/2= P[X, = -1/ n). 

| Fori» j. | X, I»1X, | so that { ІХ; I» є) с {| Х,1> =} whence the sequence ( | X, | > £) 


‘js a decreasing sequence. It then follows that Uu x, I»£] - (IX, 1» £}. 


i=n 


hoosing n > 1/£, i.e. € > 1/п, we observe that 


E Let (X,) be a sequence of independent variates such that 
P{X,=1}=p, P{X,=0}=1-p,. 


es i then P{I X, ize} = P(X, = 1} =p,. Consider 
Pp) Ox, E X PIX; |>є}= Xj. 


ј=п jen jen 


, = 
P| Ou X; |> J - P(IX,I» e) € P(1X, 1» 1/1) 20. = Thus, X, — 0 almost surely. 
ien 


us, if Ep, (j = 1, 2, ...) is convergent, then lim TAI 25 0 
: jen 
X, > 0, almost surely, if Ур, is convergent. 
nark. Let r > 1. Choosing p, = l/n', we may get several concrete situations. 


) C se of Convergence in the Mean 
isider a sequence (Х,) of independent variates defined by 
P{X, 21) = 1/п, P(X, 20] = 1 (1/п), п= 1,2, ... 


E(X, - 0r) -EQ X, ) = (00) 0as n oo. 
ows that X, — 0 in rth mean [X, —™ 0]. 


a sequence of variates (X,) defined by 
Р(Х, = 0) = 1 - (15), Р(Х, = п) = Vn, uud 2 


X, -0! ) -Ed X, P) 20. (1-72) «(0/5)». 
°{ X, - 01} #0, so X, + О in mean square. 
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Example 1. Give an example of a sequence of r.v.s. which converges in distribution, 
(i) but not in probability, (ii) but not in any other mode of convergence. 
Solution. (i) Let P(Y = +1) = 1/2 and define the sequence ENS SX, ... by 
X, = Yif nis odd; X, = -=Y if n is even. 


Obviously, X, —14 Y as n — o, because each variable in the sequence has the same 
distribution. However, X, – Y = 0, if n is odd; X,- Y = -2Y, if n is even. 
P(IX,,-YI»1) = P(I -2YI» 1} =P{l Y12 12] = КУ я. 


This proves that X, ——Y. 
(ii) Let X ~ Ber (p), p = 1/2. Let Х|, X,, ... be identical variates given by X, = X, v n, 
The X's are certainly not independent, but X, —4> X . Define Y= 1 – X. Then Y ~ Ber (p), 
p = 1/2. Obviously, X, oY, because X and Y have the same distribution [P(X - 1) 
= 1/2 = Р(Х = 0)]. However, X, —*>Y in any other mode of convergence because 
|X, У = 1, always. 
Example 2. If Х|, X,, ... is a sequence of r.v.s. and X, —"—› X, then X, —-— X also. 
Is the converse true ? 
Solution. (i) We have P(IYI»c] xE(Y')/c', [Bienayme' Inequality]. Take Y = X, - X 
to obtain 

P(1 X, - XI» c) xE(QGCG, — X) / c? > 0 (by hypothesis). This proves X, ——> X. 
The converse to this result is untrue. Неге is an example X, —"—, 0 but X, —=> 0 
(ii) Let a sequence (X,) have the p.m.f. : P(X, 20) = 1 - n'', P(X, =n) =n". 
Then, given € > 0 and for all large values of n, 
P(IX,1» =} = PIX, =n} = п 0 as n — co. Thus X, —" 5,0. 


1 г 


E[(X, _ 0)" ]=E(X)=0.(l-n"') +2" .n =n ' + аз n— ©. (к> 2). 
Thus X, —7— 0. 

Exercise. Verify the following results : 

(a) If X, —55— X and Y, —5— Y then X, & Y, —*—» X «Y. 

(b) If X, —£—» X and Y, =» У, thaw X, Ны Jn 

(c) If X, ——» X and Y, —L» Y, then X, +Y, —> X +Y. 

(d) If X, — X and Y, —L» Y, Фетх 4 Y, ES ys y 


(e) If X, > X and Y, —— c, then X, + Y, —4» X 4 c. 
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L 
(О if X, —— X and Y, ——» Y, then (X, + у) a> (X 4 Y). 


(g) If X, —— X and Y, —/" c, then X, .Y, —> cX 
: d : " 
(h) If X, X and Y, — c, then КИЛҮ, —@-—› Хус. [Cramer’s theorem 


11-30. Continuity (or Limit) Theorem for M.G.F. 


ES име X, have the c.d.f. F (x) and m.g.f. М (f), that exists for | 1 | < h, for all n. 
If there exists a c.d.f. F(x) with corresponding m.g.f. M(t), defined for | t | € А, < A, 
such that lim M, (f) = M(t), as n > œ, then X, has a limiting distribution with c.d.f. F(x). 


Continuity (or Limit) Theorem for Ch. Function 


Let X, Х|, X,, ... be r.v.s. with ch. functions 6, ,, ф,, ... Then X, —— X iff ф,(0) > 
ф() V t € К. 
Example 1. If X, —— X, then aX, + b— aX +b. 
Solution. ф(7 : aX, + b) i lat : X,) > gl ф (at: X) as n > o. 
b(t: aX: b) = e" à (at: X) = іт $ (t : aX, + b). 
Example 2. Let X,, X, ..., be indep. Cauchy r.v.s. Show that X, = (5, / n) —— X, as n о. 


Solution. $(t: X,) - $(t: X,). [See 88-71]. Hence $(t:X,)O $(t:X,) as n > ©. Thus 
X—L»X,. 
Polya's Theorem 


ИР ә F and F is continuous, then the convergence is uniform, е. 
lim sup | F,(x) - F(x)! = 0. 


noo 


Proofs of these three Theorems are beyond the scope of this book. 


11-31. Worked-out Problems on Limiting m.g.f. 
Example 1. Find the m.g.f. of bin (n, p). Deduce that m.g.f. o 
-P/sy' Show that, as n — 9o, this tends to e^. 


f standardized binomial 


is (р.е“!° + qe 
Solution. Let X * = (X ^ np)! {пра =(X — np) / o where o = Jng. Using mgf of X, we have 


iex (iE) nmm ga] arp = (pe^ + qe 
o [9] 


-pilo y 


For limit-process, we use exponential series : 


pec + ge Pte = 


1 


1 + (2/2п) + O(1/n) 
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—— 


M(t : X*) = [1 + (7/2n) + 0(1/п)]'. 


lim M(t: X*) = lim [1 + (t° /2n)+0(1/n)]=e" 2, [m.g.f. of N(0, 1)], by Euler's limit. 


n» 00 


It follows that, as n -> co/X* tends to be normally distributed. 


Example 2. Let X, ~ NB (k,, q,),n = 1,2, + ON d 60, o, =» 0, (q, = | — p,) and 
ор, > À (fixed) as n — ©, find the limiting distribution of mos 


Solution. M(t:X) = (q,/(1— p,e ))" &(1- p)" .(1- p,e y^ [$ 8-16(6)] 


ky =k; 
Ф 1-2. fi- Me) —e ^ e еме!) ask —»0o [By Euler's limit] 


n 


Thus, M(t : X,) > m.g.f. of Pois (А), hence X, —^— X where X ~ Pois (А). 


Problems with Solutions Provided at the End of the Text 
1*. Let X ~ bin (л, p). If n — о and p > 0 in such a way that np = A (constant), then 
X — Pois (A). 
2*. Let X - Pois (A). If A — o, then Poisson distribution tends to be Normal distributed. 
3*. Let X, ~ gam (n, A). Find the limiting distribution of Y = (X,/n) as n — oo. 


4*. Let X ~ NB* (k, p). Show that, as p > 0, 2pX ——>Y where Y ~ Y a PH 


Exercise 11(a) 
1. Let P(X, 2 1) = Un, P(X, 20] 21 — 1/п. Find the limiting distribution of X,. 
2. Let P(X, = £1) = 1/2. Find the limiting distribution of Y, = 24 42^. | <k <n, when X, are 
indep. variates. 
3. Find the limiting distribution of (Хп?) when X, ~ ji MA 
4. Find the limiting distribution of X, and X, are standardized normal variates with 


P; TALAT 1625... 
5. Let X, ~ gem (A/n). Show that (X,/n) ~ Expo (A) when л oo. 


6. ех, ~ Pois (А). Show that (S, —nd)//nd has №0, 1) distribution as n — oo. 
7. COs, ~ NU, с2). Show that X, > N(u, o^), when н, p and с? > o. 


11-40. Definition of the Weak Law of Large Numbers (W.L.L.N.) 
A sequence (X,) of r.v.s. is said to satisfy the weak law of large numbers (W.L.L.N.) if 


lim P(1S, /n - E(S, / n)| « e] = | 

Neo 
for any є > 0, where S, = X, +X, +... + ^ 
Note. This law is weak because it is formulated in terius of distributions alone, rather 
‚һап convergence of r.v.s. themselves. 
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11-41. Theorem : Weak Law of Large Numbers "M 


Let (X,) be a sequence of random variables and let S, = =X,+...+X_, with B, = Var 6S.) 
< о. Then, for any € > 0, n n 


im Р S -Е(5.) 
>" | n n 


provided (B,/n^) — 0, as n > o. 

Proof. Chebyshev's inequality applied to variable (S/n) gives 
РЕВЕ var (S:) r8 
n n g? n'g? ; п п? 

As n > ©, the right side of this inequality tends to zero (by hypothesis). Since probability 
is non-negative, the above provides 


lim P(I(S, / n) - E(S, / n)1 2 £) - 0, or lim P(I(S, / n) -E(S,/n)l«e) = 1, as n — œ by 
complement rule. 


Cor. Let X, =S,/nand p= E(S, / n); then 


Е lim Pi X, -E(X )i<e}=1 


0, ifk «pu 
lim PIX, <k : 
кш {x z il jj БЕ > 
Proof. The statement of WLLN reads : 
lim P(IX, —pl<e}=1, or lim P(IX, - Ш> s) = 0. ~T 


Since {X, E gx - ці е}, hence Р(Х, xy - exp - €) < РХ, – ilz e). 
Proceeding to the limit and using (i), we get 

lim Р(Х, <k}=0; k2u-&, £20 > k«yp. 
Further : P(X, «p +} + P(IX, —ul» £) 2 1, since region larger than sample space is 
covered. Now put k = и + =, take limits as n — oo and using (1) we get, lim PIX &k]-T 


Remark. The condition (B, In? ) > 0 as n > © is necessary as well as sufficient for 
WLLN to hold for a sequence of uniformly bounded variates. This fact is established 


in Theorem 11-61. 
11-50. Some Variations of the W.L.L.N. 


l. Mean-square law of large numbers 
Let Xi, X,, ... be a sequence of indep. r.v.s., E(X,)= p, Var(X,)=0*, 1 £ k « о. Show 
that (S п) p. 
Proof. As usual, 5 = X, + X, + a: + Xy E(S,)=E(% +--+ X) eni ES, /m =. 
Var ($,) = Var (X, +...+X,) =n Var (X,) =no?; Var (S, /n) - o^ /n. 
" EKS, / n) -pf = Var (S, /n) =o" / n» 02s n о. 


: Thus (S, / n) —9— p as n o. (r = 2). 
FN 
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2(a). Bernoulli’ WLLN 
Let (X,) be a sequence of Bernoulli trials with probability of success equal to p. If 5 is 
the number of successes in л trials, then 


lim P(I(S, / n) - pl«e] = 1, V £ » 0. (1) 


Proof. Since X, = 1, with prob. p and X, = 0, with prob. g = 1 ~ p, we have 
E(X,) = p, E(X7) = р, Var (X,) = p(1 — p) = pq. 
E(S,)  E(X, +...+ X,)- np, Var ($,) = npq [X, are i.i.d. indicators} 


Thus E(S, / n) = p, Var (S, / n) = pq/ n. By Chebyshev's inequality 
sal «pen basia max pq = 1/4). 


P| 5 
e? 4ng? 


ia LU 
By Complement rule, we rewrite this 


n 


P{\(S, / n) - pl«e) z 1— (1/ 4пє?). 
As n — оо, this reduces to statement (1), as p Ф І. 
Remark. The probability of “the relative frequency being close to p” approaches 
l as the number of trials increases. 
2(b). Borel WLLN 
Let R(A) be the relative frequency of an event A in n independent and identical trials 
of an experiment. Then 


P(IR(A) – P(A)I» є} 9 0, as n — oo G Ар 


=) 0 8 A) 


That is, for large n, R(A) is likely to be close to P(A). 
Proof. Let X, (i € j € n) be i.i.d. Bernoulli variates with parameter pO0«pc«Il. 


Let 5, 2 X... -X, and X, =S,/n.Now M(t: X;) - E(e" j) = ре! + ge" =q + pe'.So 
M(t: X,)=M(t:S,/n) = M(t/n:S,)=[M(t/n: X)" z[q p" = [1+ p(t / n) O12] - 


Asn-— o, M (t: X, — e" (m.g.f. of degenerate r.v.). Hence as n — co 


P{(S, / n) £x) 9 FG) = e : Li x - 


>60 аѕ 2 Try 
The result (2) is equivalent to Borel WLLN (1). 

3. Khintchine’s WLLN 

Let (X,) be a sequence of i.i.d. variates, with E(X,)= н<, i= 1, 2, ... Then the WLLN 


holds, i.e. P(I(S,/n)- ul» =} 0, аѕ n — о. 


$11-50. Some Variations of the W.L.L.N. 373 
Proof. Here S, = X, + X; +... + X, X, = S, / n. Addition Theorem for Ch. functions give 


ф@:Х„) = $(:5,/n) = (t/n:5,) = [G(t/ n: X], (X, :i.i.d) 


= [1 + ip(t/n) + O(t/n)]" [By Taylor's Theorem] 


Asn 9, the R.H.S. tends to Euler’s limit : e", hence 


lim ф (2: vd T gilt 


Now, exp (ipt) is the Ch. function of a degenerate variate X such that P(X = p) = 1. The 
Samo 15 given by F(x) = 1, if X 2 u, F(x) = 0, if X < p. 

The c.d.f. is continuous everywhere except at X = p. Choose £ > 0, use Continuity 
Theorem to get 


lim Р(Х, xu -€ £] - lim Fy (p — =) = F(p- €) = 0. €). 
lim P(X, Sp+e}= lim Fx. (u +=) = Fy (n £) = 1. ...(11) 
lim P(X, >p+e}=0. [by (11)] .. (111) 


From (i) and (iii) follows the result : lim P(IX, —pl>e}=0= lim P(I(S,/n) = ul» є}. 
4, Bernstein’s WLLN 

Let (X,) be a sequence of variates for which Var (X,) = б, < К, for all i, where К is 
independent of n. If Cov (ХХ) = 6; > 0 asli —j1— oo, (Asymptotic uncorrelatedness), 


then WLLN holds. 
Proof. By Chebyshev's inequality : P(I X. —E(X,)12 e) « [Var (X,)/ t'viSO (D 


Further, Var(X,) = = Cov (Ex. Эх, |+ 559, 0) 


Аѕ 9; > 0 when |i - j | — oo, it follows that given 6, there is an irapa m for which 
I, | 15, provided | i — j | > m. The covariance matrix [o,,] contains n elements, the 
kas = (li-jlsm) has mn elements and hence the set A’ = {l i - j | > т} has (n? — mn) 
elements. Thus, | бү! siin A Further, by Chwarz’s inequality, lo;1 < 0;0; S K for 


all i and j, in particular, 1с; | < K on A. Now, from (2). 


Lie L [219и ies] e Ix ex 15/ 


Маг (Х„) 


іе. Var(X) < [mik «1o? ME" NE 


Provided n > (2mk/6). Thus, as п > ©, Var (X,) > 0, (5 | 0) and (1) provides 
РХ, -E(X,) 12 e] — 0, as n ©, for all c » 0. 


| di follows that WLLN holds. 


11-60. Necessary and Sufficient Condition for WLLN 


Let (X,) be any sequence of variates; write S, = X,+ Kit o + X, and У, =[S, – ECS, m 
quence (X,) to satisfy the WLLN is that 


A necessary and sufficient condition for the se 


E((Y2)/ (1 + Y2)] A 0, as n — o. | Еу 

Proof. (1) Assume that (1) holds. Now for any positive numbers a and b, a > b > 0, 
[a/(1 + a)] . [(1 + Р)/Ь] > 1. mite 
Define the event A = (1 Y, | > e}; then o €A >IY, P »g?»0. Replace a by Y, b by £ 


in (1) to get an event : 


В = ESED 


Since о €A — we B, it follows Ac B whence P(A) < P(B). 


Y, р i y i 3 
по : poen [by Markov's Inequality] ...(1i) 


1+2 1+? ВАСЕ 467) 


As n — ©, the right extreme member іп (ii) tends to zero by assumptions (1). Hence 


n 


n>% no 


10 


— 
N 


This shows that the sequence (X,) satisfies the WLLN. 
(П) Now assume that (2) holds. Let Y, be a continuous random variable with density ДУ). 
Write A = {I У, | >€}, A! 21 Y, 1< е}, then using [y/(1 + у?)] < 1, 


I4 Y, 1+ 


E [9 Y fo) , x [ j ) y, d ^ y? г 
nr. 2 v=(J, T JIN ; f) ys f fo)dy fy У(у) ау |::— < у 
п Sy У 1+ 

« P( Y, 12е) + РУ, |<) РЦК Тера е. (7 y eg? on A’) (йй) 
As п — ©, the first number on the R.H.S. of (iii) tends (о zero by assumption (2), and 
since ¢ > 0 is arbitrary small, we get lim Е[(У2) (1+ Y2)] - 0, 
Cor. Let (X,) be a sequence of independent variates, such that Var (X) < «o, i = 1, 2. 


and (B,,.)  0asn— o, where B, = Var (S,) = У Var (X). Then WLLN holds. 
Proof. (Y2 / (1% Y2)) SY; = (S; / nf where $', = 5, — E(s,). 
Ely? /(1+¥,)]<(1/n*) Var (S,)=B,,2, (Х, are indep.) 


As n — oo, (В.,:) 0, by hypothesis and so E[Y? / (1+ Y?)]-» 0 as n — оо. This in turn 
implies that WLLN holds. 
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nt Observation. The proof of Theorem 11-60 remains true even if Ay) 


jmporta 

does not exist. Define Y, = (S,,,) instead of Y, = [S, – Е(5)]/ п. Example | illustrates this 
observation. 

Example : Let Х|, X, ... be a sequence of i.i.d. Chy (1, 0) variates. Show that the 


WLLN does not hold for this sequence. 
Solution. It is easy to show that X = (S/n) ~ Chy (1, 0). [See Art. 9-71]. Now 


2 52 2 x „д i 
E im THa E Ыр ES Iu 
| 4 Y, HS. I-X' Iu IPIE UT 


b apr жий sos pe 


тм еду ул, 


sin’ Ө d0 = T [x = tan. 8] 


Since lim E[S? / (n? + 52)] > 0, WLLN does not hold for this sequence. 


11-61. WLLN for Bounded Variates 

If the variates X, are uniformly bounded, then the necessary and sufficient condition 
for the WLLN to hold is that lim (B,/n^) = 0, as п — ©, where B, = Var S, = Var (X, + X, 
uh X,). 

Proof. Assume that the WLLN holds, then 


lim P(IX, — E(X,)12 =} = 0, as n oo. Gh) 
Since X; are uniformly bounded, | Х, - Е(Х,)1< C, so X; -E(X;) « C and summing provides 
S, - E(S,) «nc, or X, -E(X,) «C gr W, «C, 
where W, = X, — E(X,). Also define the events A = (1 W, | 2 £} and A’ = { W, ! < =]. 
Further, Var (X,) = ЕХ, -E(X,) =E(W,); B, = Маг (пХ,) =n" Var (X)... (2 
Let F(w) be the c.d.f. of W, and write W for W, for neatness; then 
Ew?) = [_wdF(w)= [Fo + f w dF Ow). 
Now on A’, w^ < £ and on A, te (boundedness), hence the above gives 


E(w?) < C? | aFQw) «s? | dFQw) = C^ РСА) + € PCAP. ua 
From (2) we get, (В In’) = Var (X,)=E(W’) , and thus (3) becomes 


(B, / п?) <C? P(A) + €' P(A’). 
As n + o, P(A) — 0 by (1) and since P(A’) < 1, we finally obtain : 


іт (В, / п?у<є? => іт (В, / п?) > 0, (c } 0) as n ©. 


E fact : lim (B, / n) — 0 implies holding of WLLN, has already been estab! heg 
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11-62. Worked-out Problems 
Example 1. Show that the indep. sequence P{X, = +2") = 1/2 does not obey the WLLN 


Solution. Here E(X,)=2*(4) - (-2^) (1) - 0. б; = Var (X,) E32) 22" (1) - 2^ (4) =2* — 4 
Y, -Y4'-iu - 0). 
kal kl 3 


TE M a à hs 
lim [eR En M E ko 4 in4| 2 (Un 4)* lim 4" > o. 
2 З n>» 2n 3 n 


Var (S,) 


noo n 


where we have used L'Hospital Rule for evaluation of (оо/оо) form. Since the condition 
Var (S,)/n" — 0 is only sufficient, not necessary, it does not follows that the WLLN 
does not hold. Further testing is necessary. We follow m.g.f. technique. 


M(t:X,) = Бей) = 5e ele isi) 


M(t: S/n) = M(t/n:S,)=M(0,X,+..+X,), [O9 t/ n] 
= М(Ө:Х,)...М(Ө:Х,)= (е9 +е2'9)/2}, [у (i)] 
= (1/2)' II (p +p~ ), where p = e? 
Q')M(:$,n) = ТЦ(р? «p? )(p* -p?')/(p? 27) 
= Hp" p^ Mp =p he Mee <n) 


a р? =e p? iam p x ETT 
2 UT -2 * 2 29? RSS A _эп 
Р EPIS, PUE pep 
n+l _(эул+1 n+l "E 
м рТ 60е л ало nog. 7n 
рб, e” e” . sinh (20) 
| i podhi ysinb {Qype | E. 
So M(t: S/n) = sinh (277) Use sinh x = x + em m 


aN 


2" B+ (B°/3!) + (B°/5)) +... 


ові +4 (a?) 
where a =2 м 3 XU n 


sso [EEE 


As n — œ, В — 0 and a — oo. Thus M (t : S,/n) — o as n > © 
By Continuity Theorem, we conclude that the WLLN does not hold. 


Remark. We shall not repeat above expanded arguments in the followi bis; 
tions. 
The reader shall supply the details. owing solu 


$11-62. Worked-out Problems v 37 7d 


Example 2. If X; can have only two values ič and —i*, with equal probabilities, show 
that WLLN can be applied to (X,), if a <+}. Also discuss the case when «a = 1. 


х 
20 
1 


polation. Here E(X,)= 31" +1(—®у= 0. Var (Х,)=Е(Х?) = 


B, be 1 12° 229 n? j 1 12° 322 n^? 
2 == +®=—-..+—— |< EL ES 


n n\n no. KR 
By Cauchy’s First Theorem on limits, 


й 12° 20 , 2a 2a 
lim [em 5 eser jal- lim ic J-o if 20 « I. 
no n n>% n 


Hence lim (Вп/ п?) = 0, as n — oo 


It follows that under this condition (a <+), WLLN holds. 
Case a=1. Here o? =i", so that Var (S,) = Xi? = n(n + 1) (2n + 1)/6. Thus (B,,,2) > ©. 


Further, E(1X, 1) *? =(i)'*®,8>0 is unbounded. Hence (X,) does not admit of WLLN. 
Example 3. Prove that the WLLN is applicable to the arithmetic mean of a sequence 


of independent variates X, specified by P(X, = + /ink}=+ 
Solution. Here E(X,) = 1 (п)? – 1 (п)? =0. Var (X,) =E(X;) = 10) + 1 (n) = (п. 


B, = TO. — (n1 +012 +... + ÓÜnn = nn! 


B, es 0п2 zd Е (п2 2d 
EE r—rut—|€-|—— + +... + — 
x cwm n n| 1 2 n 

Since lim (0nn/n) = 0 as n— oo, Бу Cauchy's First Theorem in Limits, (B,/n^) > 0 
as n — oo. 

Hence lim (B,/n^) = 0, as п — ©. | 

This proves the applicability of the Weak law for large numbers. 


Problems with Solutions Provided at the End of the Text 
1*, State WLLN. Let Xp X,, ..., X, be i.i.d. variates with mean p, and variance с? and 
as n — oo, Ys + x +... X2)/n—»c for some constant c, (0 < c < oo). Find c. 
2*. If the 11.4. variates X,(k = 1, 2, 3, ...) assume the value 9t Bese Үү 1 2,3,..) with 


probability 1/2’, examine if the WLLN holds for the sequence (X,) 
B". A sequence of independent variates (Х,,) is defined by 


PY. eri |. Eig 21,2 3... [r is a positive integer] 
„УЕ a+r) s 


E Show that (X,,,) admits of WLLN. 
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4*, 


8". 


6". 


Б". 


МР 


10". 


Ia". 


Let Х|, X», ... be a sequence of i.i.d. U(0, 1) variates. For the geometric mean 
Gu XH Su Kye; show that G, —2-»<, where c is some constant. Find c. 


Sequences (X,) and (Y,) are defined by the laws : X; ~ U(0, j) and Y, ~ U(-j, j), 
| <j € n. Do they obey WLLN ? 
Show that the following sequence of indep. variates does not obey WLLN : 


Pix, =+(2k-1)'} = 1/2. (X, : independent) 

A variate X, has the distribution 
P(X, 0). = 1-2 (2/89*2), P(X, = 3") = P(X, 9-3) 23 0**?. 

Does the WLLN hold for the independent variates sequence (X,) ? 
Let (X,) be a sequence of mutually independent variates such that 

Pix, md) Sh 204) PRR, 5 0р", 
Does the WLLN hold for this sequence ? 
(1) The sequence (Xj) is such that E(X?) < A’, for all k = І, 2, ... and each variate 
X, depends on variates with adjacent numbers. Show that the sequence obeys 
WLLN. (ii) Using Chebyshev's inequality, find the upper bound of 

Pi|3Qt + X, )- FE, +X,,,|26, жоры. 


The variates Х|, X,, ..., X,, ... have equal expectations and finite variations. Is the 
law of large numbers applicable to this sequence if all the covariance O; are 
negative ? і 

Let X, Бе 1.1.4. variates ¢ = 1, 2 ... with mean p and variance с? < oo, and let 
S,=X,+...+X,. Show that the WLLN does not hold for the sequence (5), but it 


holds for the sequence (a, Sy) provided na, — 0 


Exercise 11(b) 


. State the limit theorem for characteristic functions. 


Examine whether the WLLN holds good for the following sequences of independent random 
variables : 

(а) PIX, -(-D'k) 26/ 1 K', k=1,2,3,... 

(D P(X, 224^ a, 

(с) “Р(Х, 2 £k" ]-1. 

(d) P[X, 21] 2 p,, P(X, 20] 21- py 

(e) Р{Х, -k] 2 1/ KC), k = 1,2,...апа €(3) = (1 / К^). 

0 РК) = 1. [No] 

(p P{X, = +1) =k". Р(Х, =0}=1 -2k". 

(h). P(X, =+V3)=1/6, Р(Х, 20) - 2/3. 


СЄ a o — 


е 
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(D Р(Х, -k ^) 22/3, РХ, = – 12) 1/3, 

G) P(X, 2x2']22'?'*5. PL, 20] 21-27. [Yes] 

(k) PIX, =k] = p, P(X, =1+ k^] 21- p,. 

(D РХ, = £k) - (1/2 Jk), P(X, 20) 21- (1/ VR). [No] 

(m) P{X, 2 £2] = 1/2^*', P(X, = +1) = 1(1- (1/2)4]. 

Let (X,) be a sequence of independent variates such that : 

(a) Р(Х, 2 £k") - 1, P(X, = 0] = 1. Determine o for which WLLN holds. [a < 1/2] 


(b P(X, =+2k"}=4. Determine a for which WLLN holds. [a < 1/2] 


. The following sequences are composed of pairwise independent variates. Show that WLLN 


holds for such sequences : 


(a) Xni = tJ/n,0 (b) хы = + {пп (с) х, =+na,0 (d) x,; 2 £naz0 


yee} 


P(X, —x,)-71/n1-2/n Р(х, = x) = 112 P(X = x) 221,1 - 14m P(X = x4) =1л,1- 1 
Verify by direct calculation that the WLLN holds for a sequence of independent M(u, с?) 
variates. 


. Variates Х|, X,, ... are such that E(X,) = 0, P{I X, |< 4) 2 1, к= 1,2, ..., and Var (S, / n) E 


as n — ©. Prove that X's cannot be independent and that WLLN does not hold for X's. 

Let Х|, X,, ... be i.i.d. variates with p.m.f. f(x) = o^/(1 о), x 20, 1,2, ..., 0«a < 1. Show that 
WLLN holds for X's. 

Let Х|, X,, ... be i.i.d. variates with c.d.f. 


F(x) = (1/ 2a?) u(x + a) + (1 14 a?)u(x) + (1/ 2a”) u(x — а), [a> 2] where u(x) 21, if x > 0; 
u(x) = 0, if x < 0 (unit step function). Does the WLLN hold for the X; ? 


. Variates X., X,, ... are independent with P{X, = +a,} =p,, P(X, 20] = 1 ~ 2p,. Show that the 


sequence (X,) obeys the WLLN if n (Ура?) > 0 as n > œ (i= 1, 2,..., n). 
Let (X,) be a sequence of random variables such that X, is independent of X,, j# k + 1, j * 1. 
If Var (X,) « c, (const.) for all k, show that WLLN holds for (X,). 


The p.d.f. of a variate Y is f(y) — 4, —1< у< 1. Show that the sequence (X,) satisfies WLLN 
where X, = sin (knY), k 21,2, .... 
Let X, i < i < n be uncorrelated variates with common mean р and variances c; respectively. If 


there exist constants a > 0 and В < | such that o? <a, then WLLN holds for the sequence (X,,). 


In a sequence of independent games it is possible to win or lose a unit stake at the Ath game 
with probabilities p, and 1 — p, respectively. If S, denotes the total gain in the first n games, 


prove that lim P[n^! | $, -E(S,)12 є} = 0, V & > 0, irrespective of the values of the p,. Hence 


no 


strengthen the WLLN to show that for any P,. 
lim P(IS, = E(S,) Iz en"? dn n] = 0. 


no 
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13. Let | CET SM uncorrelated random variables with mean zero and common vari; anc 
eL] 
bou" sae the WLLN holds for the sequence (Y) where 


- Yy27X,. Eel? 3 
j=! 


14. Prove that the WLLN holds for a sequence of random variables in which each variate |. an 
depend only on variates with adjacent numbers, and all the variates contained in the sequence 


have finite variances and expectations. | 
15. A pack of cards numbered 1, 2, ..., n is shuffled and the cards аге dealt one at a time. The 
variate X, possesses the values 1 or 0 according as the ith card dealt has number i on it OF not 
and each card is equiprobable to appear at the ith place. Show that the WLLN holds for the 
sequence (X ). 
16. A sequence (Z,) is uniformly bounded, i.e. 
Pla€Z,sb)z1,nz1,2, ... (a, b finite constants). 
Suppose that for any є > 0, lim P(IZ, = mlz eg) = 0, аѕ n — oo, m є[а, b]. Show that 


lim E(Z, ) = m, as n — oc. Give an example to show that this result does not necessarily hold 


if the condition of uniform boundedness is removed. 


17. Let (X) be a sequence of variates with o? < A, Yn and O; > 0 asli -jl— o. Show that the 


WLLN holds for this sequence. 
18. Bernstein polynomials. Let f : [0, 1] — R be a continuous map. Using WLLN, show that 


lim хл (2) ("| x"(p-xy oly, F(x), OS ү е. 
n9 ,-Q NM 

11-70. Definition : Strong Law of Large Numbers (SLLN) 

A sequence {X,} of variates is said to satisfy the strong law of large numbers (SLLN) if 


([S, / n - E(S, /n)]} —**-> 0 as n— oo. 


Note. This law concerns intrinsically the convergence of random variables themselves 
rather than their distributions, hence it is a strong law. 


1. Kolmogorov's SLLN 


Let Х|, X,, ... be independent variates with E(X.) = Hu, Var (X,) o? « co. If Efo? / ]<«, 
k = 1, 2, ..., ©, then SLLN holds for the sequence (x$. 

2. Necessary and Sufficient Condition 

The existence of the expectation is a necessary and sufficient condition for the SLLN 
to hold for an i.i.d. sequence (X,). 

3. Borel's SLLN 

For a sequence of Bernoulli trials with constant probability p of success, the SLLN holds. 
4. Difference between WLLN and SLLN 


We have (i) WLLN : If X, —^— y; (ii) SLLN: If X, аз у, 


$11-71. Theorem: Strong LLN for Independent and Identical Variates 381 
The WLLN States that for any fixed large value of n, say m, (5 /m) is likely to be near 
р. However, it does not say that (S,/n) is bound to stay near р Vn » m. It means that the 
large values of | (S,/n) — p | can turn up infinitely often, may be at in frequent intervals. 
The SLLN shows that it cannot happen. In particular, it shows almost certainly that : 
|(S,/n) - u | > £ only a finite number of times. 


Proof of one simple version of SLLN is now offered. Proofs of other results are beyond 
the scope of the present text. 


11-71. Theorem : Strong LLN for Independent and Identical Variates 
Let Х|, X5, ...‚ X,,, ... be a sequence of 1.1.1. variates; each having a finite mean y = E(X;) . Then 


Pim 3X = yh a, 
n 


Proof. We start with assuming that p = 0 and write 5, = X, + X, +... + X,. Then 
dou EM = УХ, = УХ, = УХ for i, j, К, r are dummies. Now 


BS) = ЕХО УХ, (X 9) (1) 
The expression above in R.H.S. consists of the terms of the types 


Ea ХАМ. X XX, 


Rt Уу 


As E(X,)=0 and X;, Х,,... are independent, we have 
E(X? X;) EO NEX) = 0, E(X?X,X,) =Е(Х?)Е(Х)Е(Х,)=0, EQGX;X,X,) - 0. 


Now, for a given pair i, j there shall be (3) =6 terms in (1). Thus we can rewrite (1) as 


E(st) = лЕ(Х#)+ 6(,)Е(Х?Х;) 
eink а DE ЕС): [A  E(X7)] 
From Var (X2) = E(X#)-(E(XP)P 20 we get [EY <a 


E(S;) < nÀ + 3п(п- 1). 


m E(S? /n*) < (1m) + (3А / т?) 


Extending n — о, this yields 


4 
ESL di (3 ]-« (Convergent Series) 
es] - 6 


4 a7 


yg 4 
! + Эһ | oo, 
This result implies that, with probability 1, 2 E - 
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For otherwise, the sum being infinite yields infinite expected EN. » for COnVergen, 
series, the nth term tends to zero as n — ©, hence, with probability 1, 


4 x 
4 1; $ 
lim За = 0, i.e. lim [s =0 => lim (Sa) =0 
п->= n* s noo \ M n V П 


Now if u + 0, we let Y= X, = p and apply the above arguments to sequence (У) so that, 
with probability 1, 

г nf X -u , п X; б | y (à. 

lim (nc |, = lim ду te ie, limi |=. 


noo j п-э оо "am n>n 


Exercise 11(c) 
1. I EO <o, then Е(Х,) =Е(Х) =. and Pf lim (X,)=u}=1. 


2. If E(S2) < ©, then E(S?) = c? and P(lim " -o?]-l. 


n>% 


3. If Var (Х,) <с<оо, 1 <і<лп andall X, are independent, then (X,) obeys SLLN. 


4. Show that the SLLN remains valid when E(X,) = о. 


5. Let A and B be two events in a probability space (Q, F, P). A random experiment is performed 
independently л times. Let 7, be the number of times the outcome is in A. Among these EL 
outcomes in А, there are 5, outcomes that are also in B. Show that 


Р] ting (S, /T,) = P(B/ A) = P(A) 0. 


Doubt is the father of invention. 


Кекке ы а а А АА Ан МЫ МА АА АА МЫ ААК МЫ МАА aa ste ale o ple sie nee 


I know nothing except the fact of my ignorance. (Socrates) 


Bernoulli Binomial Distribution 


12-10. Bernoulli Trials 
A sequence of trials with the following properties is called a sequence of Bernoulli's trials : 


|. The result of each trial can be classified into one of two categories, say success 
and failure (call them S and F). 


2. P(S) = p : aconstant for each trial [P(F) = q = 1 - p]. 
3. Outcomes of each trial are independent of all the others. 
4. The series of trials is performed a fixed number of times, say n. 


12-11. Bernoulli Binomial Distribution 

Let a series of n Bernoulli trials be performed, with P(S) = p, P(F) = q, (д + p = 1). Let us 
determine the probability, f(x), that exactly x successes occur in these n trials, O € x < n. 
Let 5, be the event of occurring a success at the ith trial (i = 1, 2, ..., n). Then one 
sequence of events consisting of x successes and hence (n — x) failure is 


CEPR ANCUS JUNE a 


H Ja СИ 


Since each event is independent and P(S;) = р, Р(Е) = q for all i, j, we get 
P(E,) = PCF, ) F(F; )... Р(Е, ) FF, rd PU. у=р*а"^*. 


There are [n!/ (n — x) ! x !] = "C, mutually exclusive sequence of events for which 
exactly x successes occur. Since the order is irrelevent and only the number of successes 
is of interest, the probability f(x) that exactly x successes will occur in a sequence of n 
Bernoulli trials is 


f) = (Чай, FO 2]... 


The set of ordered pairs (x, fix); O S8 x $ n] is the general binomial distribution. We shall 


often write b (x ; n, p) for (") q' 'p', or more generally X is bin (n, р) or even X is Ё (n, p). 


Definition. A r.v. X is binomially distributed with parameters n and p if its probability law is 


f(x = MIRA 0<р<1, q-1-p,x-0, Е. 2и, 


Note. п is called the index of B.D. (Binomial Distribution). 
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12-12. Simple Numericals on Probability Formula ED 
Example 1. The jury members decide independently and that eac E EU 
decision with probab. p, 0 < p < 1. If the decision of the majority 15 final, what is 
preferable : a 3 member jury or a single juror ? 

Solution. Let X denote the number of jurors who decide correctly among a 3-member 
jury. Then X is bin (3, p). For majority decision. 


P(X >2) = P(X =2)+ P(X 23) 


E Gar «(pr =3p atp = 3p -8p 


Single juror decides correctly with probab. p, hence 3-member jury is preferable if P(X 2 2) > p. 
Thus 3р? -2p >р => 2p!-3p&1«0 > (р- 1) (р- 1/2) < 0. 

Thus, if p > 1/2, three-member jury is preferable. If p < 1/2, single juror is preferable. 
For p = 1/2, P(X > 2) = 1/2, so it makes no difference what option is implemented. 


Example 2. Suppose two-and four-engine planes fly if at least half of their engines 
work. If q is the probability of failure for a single engine and engines perform 
independently, find the values of q for which two-engine plane is to be preferred to 
the four-engine plane. 

Solution. Let X be the number of engines that do not fail and let 5, denote successful 
flight with k-engine plane. Then 


P($) = P(X 21)=1- PX =0) -1- (D)? -1- q*. 


P(S) = P(X 22)=1- PX -0)- Р(Х =1у=1- (о) а - (f) @®р=1— 44° e 34^, (p-1- 9). 


P(S,) = P(S) = 1-4* 21-44 +39", or q'(1- 44-39) «0, i.e. g? (1- жү 39) «0. 


If а = 0, q = 1, q = 1/3, the above is a strict equality and the two kinds of planes have 
equal chances of successful flights. 
If 1/3 < q < 1, 2-engine plane is preferred. However if 0 < q < 1/3, then the 4-engine 
plane is to be preferred. 
Example 3. Teams A and B are playing a series of games, each of which is independently 
won by team A with probability p and by team B with probab. g = | — p. The winner of the 
series is the first team to win 4 games. Find E(X), where X is the number of games played. 
Solution. Since series is won by 4 successes, there cannot be more than 7 games 
between A and B. We define the events for A and similarly for B. 

A, = (Team A wins К games out ОЁ n games played) 

A, = (Team A wins kth game} 


P(X = 4) = Р{А tt BZ} = PAD + P(B;) = р“ + q* 
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Р(Х = 5) =P{A; A, U BY B.) = P(A’. A.) + Р(В?. В.) 


Du), 
v i(3) 0 a} p [В pta=4 pa(p rq). 


-— -- 5 5 
P(X 26) 2 P(A; . A; U B; B,) = PA; AQ + P(B} Bg) 


= 5 Lao 5 D. d ) ) 2 4 
aoa P pr (3)r'« 4=10ра (р Fag). 


P(X = 7) 2 PIA? . A, U By Bj] = РАФА) + P(B% By) 


6 | | 
(erje fepe] mes en 


E(X) = Ek P(X =k) = 4(p*  q*) + Sl4pq(p? + q°)]+ 6(10 p? q^ (p? + 4?)1+ 7 Q0 pg). 
wore, Uf p= а= 1/2, then E(X) = 8p* РВ 40р? а; 260p* = 03/16 = 5,813. 

Example 4. A spider and a fly are situated at the corners (0, 0) and (n, n) of a rectangular 
grid. The spider walks only north or east, the fly only south or west. They take their 
steps simultaneously to an adjacent vertex of the grid. Show that, if the successive 
steps are independent and equally likely to go in each of the two possible directions, 


2 
the probability that they will meet is 3 (4) 5; Ф 


Solution. Suppose the insects meet after k 
steps. If the spider walks a steps east and b 
steps north, it is at (a, b) with a + b = К. The fly 
must walk n — a steps west and n — b steps 
south, it is at (а, b) with (n — a) + (n – b) =k. 
Using a + b = k provides k = n. Thus 
à + Ъ = п, which means that they meet only 
on the diagonal DD'. 

The probability that spider meets fly at 
(a, n — a), it moves a steps east (hence n — a 
Steps north), so SPIDER 


T "n T n-a i i n e 

Mac eq ӨӨ lo «(5 1? 

The probability that fly meets spider at (а, n — a), it moves (n — a) steps west (hence 
а Steps south), so 


ма-а „ШЧ 7-087 


~ P{Insects meet at (a, n - a)} = P(X = a, Y =n - a) 


= P(X =a) Р(Ү =n-a)= (c (3) | 


386 Bernoulli Binomial Distribution 


п P 2 | бы | 2т i М y. оп | 2n 
ree quum = > (z) (5) -(3) 2. si =| n (5) ; 


а=0 
п+т - n mis (2')- ; pe (mznsr). 
since | Е | 2, ARA n m JJ MU 


Problems with Solutions Provided at the End of the Text 


1*. In a family of four children, find the probability that there will be (1) at least опе 
boy, (ii) at least one boy and at least one girl. Assume that the probability of а 
male birth is p = 1/2. 

2*. A family has 5 children. Find the probability that this family has at least one girl, 
given that they have at least one boy. Assume that either sex-birth is equiprobable 
and all 5 births were independent. 

3*. A radar system has a probability of 0.1 of detecting a certain target during a 
single scan. Find the probability that the target will be detected (a) at least two times 
in four consecutive scans (event A), (b) at least once in twenty scans (event B). 

4*. A room has three lamp sockets. From a collection of 10 light bulbs of which only 
6 are good, a person selects 3 at random and puts them in the sockets. What is 
the probability that room will have light ? 

5*. A and B play a game in which their chances of winning are in the ratio 3 : 2. Find 
A's chance of winning at least three games out of five games played. 

6*. An experiment succeeds as twice often as it fails. Find the chance that in the next 
six trials, there shall be at least four successes. 

7*. What is the probability of obtaining 50 heads in a throw of 100 coins and then 
repeating this event two times in the next five throws ? 

8*. If a fair coin is flipped an even number 2n times, show that the probability of 
obtaining more heads than tails is 


TEON 


9*. Show that if a coin is tossed n times, the probability of not more than r heads 15 


OOG 


10*. If E, denotes exactly r failures, find the chance of success if P(E,)/P(E, |.) in ” 

trials is independent of n. | 

/ 11*. An irregular six-faced die is thrown and the expectation that in 10 throws it will 
given five even numbers is twice the expectation that it will give four even 
numbers. How many times in 10,000 sets of 10 throws, would you expect to че no 
even numbers ? 

..— 12*. Suppose n balls are distributed at random into N boxes. Find the probability that 

there are exactly k balls in the first r boxes. 


13*. 


14*. 


J15*. 


16*. 
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Of two equally strong ping-pong players A and B, is it more probable that (a) A 
will beat B in 3 games out of 4, or in 5 games out of 8, (b) at least 3 games out 
of 4 or at least 5 out of 8 ? 

A certain airline sells 100 seats on a plane that has 95 seats, so as to compensate 
5% defaulters. Find the £hance that there will be a seat available for every person 
who shows up for the flight. 

If m things are distributed among a men and b women, show that the chance that 
the number of things received by men is odd, is 


i[(b a)" – (b— a)" ]/ (b - a)". 
If a coin is tossed n times, where n is very large even number, show that the 


probability of getting exactly (2л – х) heads and (2л + х) tails is approx. 
(2/nn)'? exp (—2x7/n). 


Exercise 12(a) 


The probabilities that in a factory, a worker is skilled is 0.4. Find the probability that out of 
5 workers, (i) none, (ii) one, (iii) at least one, will be skilled. 

Ten coins are thrown simultaneously. Find the probability of obtaining at least seven heads. 
What is the probability of getting 6 or more heads ? 

Eight coins are thrown simultaneously. Show that the chance of obtaining at least six heads 
is 37/256. 

A man tosses a fair coin 10 times. Find the probability that he will have 

(a) heads on the first five tosses and tails on the next five tosses. 

(b) heads on tosses 1, 3, 5, 7, 9 and tails on tosses 2, 4, 6, 8, 10. 

(c) 5 heads and 5 tails ; (d) at least 5 heads; (e) not more than 5 heads. 

If on average, | vessel in every 10 is wrecked, find the chance that out of 5 vessels expected 
to arrive, at least 4 will arrive safely. 

In the long run, 3 vessels out of every 100 are sunk. If 10 vessels are out, what is the probability 
of safe arrival of (a) Exactly 6, (b) At least 6, (c) At most 6. 

In a 20-question, 5 answer multiple-choice examination, what is the probability of getting 6 
or more correct by mere guessing ? 

If an ordinary die is thrown 4 times, what is the probability that 

(a) exactly two 6's occur? (b) Two or fewer 6's occur ? 


LAT Six dice are thrown 729 times. How many times do you expect at least 3 dice to show a five 


Or six ? [f= 233] 


10. Ifthe birth sex ratio is 49 girls and 51 boys, find the probability of there being 8 or more girls 


amongst 10 babies born on the same day in a maternity hospital. 

Out of 800 families with 4 children each, how many families would be expected to have 
(a) 2 boys and 2 girls, (b) at least one boy, (c) no girl, (d) at most 2 girls ? 

Assume equal birth-probabilities for boys and girls. 


12. Suppose that the probability is 0.55 for the birth of a male child and that two successive births are 


p 3 


independent. If a woman is to have five children, find the probability that she will have : 
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(a) 3 boys and two girls (Б) Son, daughter, son, daughter, son in that order 
(c) children of both ei Mj ем sons, given that she already has 2 sons 
(a) An ordinary die is thrown 4 times. Find the chances of obtaining 4, 3, 2, 1 0 aces 
(b) In 4 throws with a pair of dice, find the chance of throwing doublets twice at leas 
Which of the three events A, B, C is more probable : A— at least one «ix when 6 dice are, 
B— at least two sixes when 12 dice are cast and C— at least three sixes when 18 dice are cast | 
. A perfect cubical die is thrown a large number of times in sets of 8. The occurrence of $ ora 
is called a success. In what proportion of the sets you expect 3 successes ? [Ans 27 117 
A boy can jump 5 ft. 3 in. high, three times out of five attempts. What is the chance thar in ; 
random sample of his jumps. 3/7 of them are successful ? 
A throws 3 coins and В throws 2 coins. Find the chance that A will throw greater number oi 
heads than B. 
The probability of hitting a runaway with a bomb dropped from a bomber is 1/4 Determine 
the probability of making the runaway inserviceable if at least 4 hits are required for this 
purpose on the assumption that 8 bombs are dropped in all. 
sig Ан ШЫННАН лн aod then divided into 2 groups of 
: | roup B. Each mouse in group A is given a doze a of a certain poison 
in 4. Each mouse in B is given a dose b of another poison which 
in 2. Show that nevertheless, there may be fewer deaths in group 8 than 
| happening is 525/4096. 
ch of 100 йет a random sample ofS ems from the lot contains 


Determine the probability that the person will accept the 


À А; | : 2 "s y f | +? - E Ж | 
Aa эЛ mbing attack, there is a/5% chance that any one bomb will strike the target 
| "SL s dec мето Quy Ao target ot How many bombs must he 
Er e Ж. е ‘the target ? [а= 11] 


Не. ise fe — 


P i D 
Mu ETE ГЕГИ! Н ушл 


h. Thre rior observations, 1 ^ 
ч ave independently and let X be ie 
— f. Py yo.» 


die. Let this random 

| 
int pem 4.51. 
е ‘one’ appears 


uc UN 2-21. Worked-out Problems 3 8 9 


КИ ы. з... 
б. An owner of five overnight cabins ics cancides; 

: occupants. He expects that b E ы considering buying television sets to rent to cabin 

s. Apects that about half of his customers would be willing to rent sets, and 


finally he buys three sets. Assuming 100% occupancy at all times : 
(a) What fraction of the evenings will there be more requests than TV 


(b) What is the prob. that 


sets ? 
à customer who requests a TV set will get one. 
f owner's cost per set per дау is e 
(c)1 Cost per set per day is c, what rental R must be charged in order to break even (no 
gain or loss) in the long run ? 


27. The chance of SUCCESS in each Bernoulli trial is p. If p, is the probability that there are even 
number of successes in К trials prove that Py = Pk- (1 — 2p) = qp; + PC! - p, . ү). Deduce : 


P.7 3l * 0-25 1- UL (a - р). 
28. Two players A and B, want respectively m and n points in order to win a set of games. If they 
separate without playing out of the game, how should the stakes be divided ? 


29. A and B have equal chances of winning a single game, A requires n games and B, n + 1 games 
to win a match. Show that the odds in favour of A are 1 + Р: 1 — P where P = 2n !/(п ! 2"). 


30. A group of 2n boys and 27 girls are divided into two equal groups. Find the probability p 
such that each group will be equally divided into boys and girls. Estimate p using Stirring's 
formula for n ! 


31. [Y.P. Sabharwal] In a sequence of symmetric Bernoulli Trials, let B, denote the number of 
trials covering the first and the last success. Show that 


E(B,) = (n=) F (п 2)2^^, Var(B,)=4 = n(2n + 1) 2" – (п +2)? 4". 
12-20. Probability Recurrence Formula 


When computing the binomial probabilities numerically, one can often use a process 
of iteration based on the chain relation 


Дх +1) = iE Б-и) O<p<l. A) 
= ThE Se E sce. eed “ABR PAE УНИН —— 
To prove it, we notice that 
/(х + 1) М n n-x-] ,x«l nN) n-x ко. ux р 
аи: URE tl 4 P mL, olin wm lagi p42) 


Eqn. (2) is equivalent to (1). Further f(0) = (1 — р)" = q”, is first evaluated and then (1) 
is applied to compute the remaining frequencies f(x), one after the other. 


12-21. Worked-out Problems 

Example 1. An urn contains balls numbered 1, 2, 3. First a ball is drawn from the urn 
and then a fair coin is tossed the number of times as the number shown on the drawn 
ball. Find the expected number of heads. 

Solution, Let В„ = (ball numbered n is drawn}, n = 1, 2, 3; and X = Number of heads 
turned up. Since P(B,) = 1/3 as balls are equally probable hence by Total-E Rule. 


1 3 
] EO = X PB) EQUB,) = у È Е(ХІВ,) 


nzl 
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Now (X | B.) = No. of heads when it is tossed л times ; so (X | B.) ~ bin (л, p). As such 
n 


n | & 
E(XIB,) = "p= 5: 80 E(X) = : dn l. 


Example 2. An N-sided die is tossed and if n shows on its top face, a coin with prob 
p of heads is tossed n times resulting in m heads (0 < m < n). Record the sample space 
and the probability for (n, m). 

Solution. Here S = ((n, m : п = 1, 2, 3, ..., N; 0 < т < п); because there can be no 
fewer than zero heads and no more than n heads on n flips. 

Let X denote the outcome of the Die and Y denote the outcome of the coin-toss. Then 


m 


. \ п n m 
P(Y =m|X=n} = P{coin tossed n times results in m heads} = (^ ]a р 


Р(Х = n) = P (face n occurs on N-sided die) = 1/N. 


1 a-m „т 
Р{Х = п, Ү= т) Р(Х =н). P(Y=mIX=n) = x (m4 pk: 
This is the probab. f(n, m). 


Problems with Solutions Provided at the End of the Text 


1*. Five balls were drawn, one at a time, with replacement, from a bag containing an equal 
number of black and white balls. The number of black balls X was then tabulated for 819 
sets of consecutive drawings to give the following observed frequency (f) distribution : 
a ei 0 1 2 3 4 5 
f ‹ 30 125 277 224 136 27 
Fit the binomial distribution. 

2*. If on the average, rainfalls on ten days in every thrity days, find the prob. that 
(1) rain will fall on at least three days of a given week. 

(ii) first four days of a given week will be wet and the remaining dry (fine). 

3*. If on an average 9 ships out of 10 arrive safely to a port, obtain mean and S.D. of 
the number of ships returning safely out of a total of 150 ships. 


12-30. Some Recurrence Relations for bin (n, p) 
Let X — bin (n, p), Y = (n — X) ~ bin (п, q) and denote as under : 


k k 
B(k;n,p)- P(X sk)= У b(x;n, p= У (ee J 
х= х=0 
її ЫЕ; п, р) = b(n-k ; n, q) [Valueable for bin. Tables] 
2. b(k ;n, p) = B(k, n, p) ~ B(k ~ 1, n, p). 


Y b(k; n, p) = 1- Y (К;п, 4), т=п +1, 


: ker kem 

4. b(k;n*1,p) = p.b(k-V,n, p) *q.b(k;n, p). 
|" B(k, n *- 1, p) = p. B(k —l,n, р) + q. B(k ; n, p). 
6. Ык, n, р) = В(п – К, п, 4) - В(п- к ~ 1; п, д). 
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$12-31. Mode of the Binomial Distribu tion 


Proof. 1. b(k;n,p) = (c) ofa" i -(„^&)4' ®р* =b(n—k;n,q). 
2. Р(Х<К)-Р(Х<К—1) = Р(Х =К) yields the result. 
3. Р(Х>г)= [= P(X sr-1)=1-P(n-X2n-—r+l)=1- P(Y 2 m). 


This amounts to stated result. 


i R.H.S. = ("pontem a(t) plat! 


L n J*() pt ч D = b(k, n +1, p). 


5. From Iteration formula in (4) we get 

Ы(х;п+1, р) = pb(x-1,n, p)* q.b(x;n p) 
Summing up from x = 0 to x = k, this provides 

B(k ;n+ 1, р) = pB(k-1,n, p) * q B(k;n, p). 


ма. OE be A X mem X REAR $ ЖЗ! = 5G 

6. RHS.= X (")ар dan > (")а p - [15 Je tp «(1 p\q" -L.H.S. 
12-31. Mode of the Binomial Distribution 
We have to find the value of the random variable 
X ~ bin (л, p) for which the probability is maximum. 
Thus, if k is the modal value, its definition provides : 


k) 2 max k +1), fik 1)). 
The probability recurrence formula [§ 12-20] gives 


FO (к+)а f( (n-k*Dp 
EDD Uw-Op' УЕ у "^ kg 


f(k)2f(k-1) => К> пр-д= (п+1)р- 1; fK)zf(Kk-1) > К< (п + 1) р. 


Combining (n) p-1xk&(n-4) p. wt 


Now two cases arise : 

Case 1. Let (n 4- l)p be an integer. Since the integer k lies between two consecutive integers 

(n+ 1)p and (n + l)p — l, equation (1) is possible iff k = (n + 1)р or k = (n + 1)р – 1. 
hus there are two modes : (n + l)p and (n + 1)p — 1. And the distribution is then said 

to be bimodal. 

Case 2. Let (n + 1) p be a fraction (rational number). Then integer k lies between two 
factions differing by 1. Hence k must be integral part of (n + 1)р. 

Remark. The conclusions from (1) can be most easily grapsed by assuming some 

Concrete values for (n + 1)p. 


392 Bernoulli Binomial Distribution A. 
Bernoulli Binomial Distribution _  — 


Example : Show that if np be a whole number, the mean of the binomial coincide, 
with the greatest term. 
Solution. Since np is a whole number and 0 < p < I, we observe that (n + 1), ;. 


fraction. Also mode of the binomial distribution is the integral part of (n + Ip, henc 


np = [(n+1)p] => mean= mode. 


d 
e 


Р à $ MP noa 
Since the greatest term of the binomial (q + р)" is the modal value, hence the mean 
coincides with the greatest term (mode) in case np 1s a whole number. 


Problems with Solutions Provided at the End of the Text 


1*. Compute the mode of a binomial distribution with (i) n = 7, p = 1/2, (и) n = 50, p = 1/16. 
2*. A pays Rs 1 for each participation in the following game. Three dice are tossed . 
if one six appears he gets Rs 1; if two sixes appear he gets Rs 2 and if three sixes 
appear he gets Rs 8; otherwise he gets nothing. Is the game fair ? If not, how 
much should the player get when three sixes appear to make the game fair ? 
3*. Let X - bin (n, p). Use Chebyshev's Inequality to find the bounds when 
(а) n = 40, р = 1/4; P{|X-101< 8}, P(1X— 101» 10}, 
(b n = 40, p= 1/2; P{ |X -201< 5}, 
(с) л = 40, р = 1/2; P{ 1X - 201» 10 kJ < 0.25, find К. 


Exercise 12(b) 


1. Find the most probable number of heads in 99 tossings and 100 tossings of a biased coin 
given that the probability of a head in a single tossing is 3/5. 


2. For a certain basket ball player, the probability of throwing the ball into the basket in one 
throw is 0.4. He makes 10 throws. Find the most probable number of successful throws and 
the corresponding probability. 


3. Find the most probable number of negative and positive errors and the corresponding 
probabilities in four measurements if, in each of them, the probability of a positive error 
equals 2/3 and of a negative error equals 1/3. 


A Let X be bin (л, р). If0 < p < (n + 1)", then the biggest probability is at the possible value 0 
: and the successive probabilities are strictly decreasing. If (n + n" « p « 1/2, then the distribution 
is symmetric, skewed to the left. It is strictly increasing until it achieves a maximum. 


5. The following data due to Weldon shows the results of throwing 12 dice 4096 times, 4 throw 
of 4, 5 or 6 being called a success, 


X i 0 1 2 3 4 5 6 7 8 9 Ig 11 12 Total 
фе Э 7 60.198 430 7319948 847 536 957 71 11 _ 4096 


гуе ig Ont) actual 
Fit the binomial distribution and calculate the expected frequencies. Campare the ?* 
mean and S.D. with those of the expected ones for the distribution. 


6. A set of six similar coins is tossed 640 times with the following results : 
Number of heads : 0 1 2 3 4 5 6 
Frequency з 7 64 140 .240 33: -75 12 | 
Calculate the binomial frequencies on the assumption that the coins are symmetrical. 
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7. Seven coins are tossed and the number of heads noted. The experiment is repe: ated 1 28 times 
with the following results : 


Number of heads : 0 | 2 3 4 5 6 7 
Frequency ; 7 6 19 35 30 23 7 | 
Fit the binomial distribution assuming : 

(a) the coin is unbiased (by the nature of the coin is unknown 


(с) {һе р for 4 coins is 0.50 and for other 3 is 0.45. 

2$. The distribution of headless matches per box of 50 in a total of 100 boxes is as under : 
No. of headless matches per box: 0 | 2 3 4 5 6 7 
No. of boxes ime 74^ 29 19 8 4 | 0 
Assuming the distribution of headless matches per box over 100 boxes is binomial, fit a 
binomial curve to the above data and test the goodness of the fit. Compare the variance of the 
actual and observed distribution. [Hint. x = 2, X f(x - x) 2/ N = 1.78, пра = 192] 


9. In 103 litters of 4 mice the number of litters which contained 0, 1, 2, 3, 4 females were noted 


as under : 
No. of female mice : 0 1 2 3 4 Total 
No. of litters е 8 a2 ЗА „24 To 03 


(a) If the chance of obtaining a female in a single trial is supposed constant, estimate this 
unknown constant probability. 

(b) If the size of the litter (4) was not given, how could it be estimated from the data ? 

(c) How could the assumption that the chance of obtaining a female in a single trial is 
constant, be tested ? 

10. The screws produced by a certain machine were checked by examining a sample of 12. The 
following table shows the distribution of 50 samples according to the number of defective 
items they contained. 

E 0 1 2 3 4 5 or more Total 

E: 18 19 9 3 1 0 50 

[Х = No. of defective in a sample of 12, f= No. of samples]. Calculate the mean number of 
defectives per sample and assuming that the binomial law holds, estimate the proportion of 
defective items in the whole lot produced by the machine. 

11. Define Bernoulli trials. Find the bounds for the most probable number of successes in a 
sequence of Bernoulli trials. 

One worker can manufacture 120 articles during a shift, another worker 140 articles, the 
chances of the articles being of a high quality are 0.94 and 0.80 respectively. Determine the 
most probable number of high quality articles manufactured by each worker. 


12-40. Simple Factorial Moments of bin (n, p) 
n п\п (n-r 
Hir) = E(X”) = 2 6 Jar * ata? (")- x” Х-Р Cui 
x=0 


rr r A-2 27 уау го пр’ 
as Le" кр’ =n" p P "a pe’ «np .(q* p ' 2n" p. 
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(r) E[X"] TAI 
Note. Since (х) = as. SO, ae Ir” 
r г! r Р. 


P.G.F. Method. — G(t) = (q+ pt)" = x run рт [Binomial expansion 
We differentiate this identity r times E ‘t to get 
np! (q+ pty"! = гэр" ("а KAY ME Ves 
np’ = b R q'* pa? EXO) [Put t= l, p * q- 1] 


Simple Moments through Simple Factorial Moments 
pj = E(X*)=E(X + X) - piy + p =n? p^ + np. 

H3 
Ha 


ЕСЕБИ + Hio) + p =n p! 4-3n7 р? + np. 


E(XS «E(X тС В 


(4) 4 


= Шау + брзу + 7h + pay =n p^ + 6n 


ио) р? + пр. 


12-41. Central Moments through Simple Moments 
Hy = ц = ш? = [n(n- 1) p? + np] (пр)? = np — np? = npq. 
da = ш – 35 By + 201)" 
= [n(n 1) (n - 2) р" + 3n(n - 1) р? + np] - 3 [n(n Dp? + np] np + 2(npy 
= (p -3pix2p')n' «(p.c Зр” 3р? —5p')n! e Qp! —3p? + рул 
np(1 - 3p + 2р?)  np(1— p) (1 - 2p) = npq (q – p). 
qu = ph -4n up + бшщ? ш“ 


р? +MP р? + np] - 4np [n p® + 3n® p? + np] + 6(np)? [n p? + np] - Xnp)’. 
We Eos n i: and collect the coefficients, thus 
Coeff. of n^ = p. - 4p* + бр? — = he = 0, 


Coeff. of n^ = -6p* + 6p! + 12p* – 12р? + 6р?а = 0, 


we: ^ 1 6n 


(4) n^, 


Coeff. of n? 


11р* - 18р" +7р? - 4p? +12р* - 8p = 3p (1.25 + p?) = 3p/q^- 
Coeff. of n = -6p* + 12р? – 7р? + pz -6p' (p — 2p + 1) – р? + p=—6p'g? + pq = pq(1 - 60) 
Hence p, = 3'p'q^ + пра (1 — рд) = npq (1 + 3npq — 6 pq). 

12-42. Central Factorial Moments 

Ha = HEHREN; роу = = пра 

Hoa) = Hs ~ Зі. = npa (q - Р) - Зра - - npa (Xp + 4) - (4 – р) = – 2npq Cp + 4) = 2р4 0 + Р)- 
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Ho = На 6p, + Пи, =[3n7 pq? + пра (1 — 6рд)] - 6[npq (q — p) + 11 пра! 
= npq[3npq + 1 6рд – 69 + 6p + 11] = 3npq [пра + 4 - 2p (1 р) - 201 — р) + 2p] 
3npq [пра + 201+ p+ p^). 


12-43. Worked-out Problems 
Example 1. Let X ~ bin (л, p) and a > 0. Prove that 


2b -=p >al < pa min {avn, Jra} ; 
n na 
Solution. Let Z = X — np, then E(Z) = 0, Var (Z) = npq and 


EIZI < JE(IZP) = JE(X — пр)? = JVar (X) = пра 


where the first inequality is Cauchy-Schwarz. Now 


р = pl Хр > ah = Р121> na < E(Z D/na € |npq [na [Markov Inequality] 
p, = P(IZI» na) x Var (X)/n^a? =npq/n’a’,. [by Chebyshev's Inequality] 
Thus, p, < тіп (pq Гап, pq ! па? ), [Composite result] 


= (pq! па?) min (аул, | pq]. 
Example 2. If X is bin (n, p), show that 


2 
E(X-,) = et Cov( X, X - Pd cov x, n - X) - -npa 


n 


2 
Solution. E(*ž-p) Lea ape шың SI pd. 
n n n п? п 


Recall : Cov (aX + b, сҮ + d) = ас Cov (X, Y). 


| 
| Boy (Ex. Dri)e- Cov (X,Y) == Var o0 - - 0 = Pd 

B n n n n n 

Cov (X, n — X) = – Соу (X, X) = - Var (X) = -npq. 

Example 3. Show that the necessary and sufficient conditions for two given numbers, 
а, b to be mean and variance of some binomial distribution are that a > b > 0 and 
а l(a — b) is an integer. Show further that when these conditions are satisfied, the 
binomial distribution is uniquely determined. 


Solution. Necessity : Let a = np, b = npq, then a > b > 0 and 
а? /(a-b) = n^ p. / np (1 — д) = n (positive integer). 


Sufficiency : Let a > b > 0 and а/а — b) = n (positive integer) 
Put b = af. where 0 < f < 1. Now 


| ‘ а”/(а - b) = а?/а(1 - Р = а(1- р = п 


[by hypothesis] 
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Thus a = n(1 — f) and b = nf(1 —f). So, if we choose f = q, then a = np and b 
the mean and variance of bin (n, p). 
Since bin (n, p) is uniquely determined by 
a and b, the assertion is proved. | 
Example 4. It is known that on the average 2/3 of the seeds of a certain Variety 
programme germinate. Use Chebyshev’s inequality to obtain an upper bound on the 
probability that the number germinating will differ from the expected number by more 
than 10 if 100 seeds are planted. , 

Solution. Here, п = 100, р = 2/3, д = 1/3, so that pu = np = 200/3, с = npq = 200/9. 
Now Chebyshev’s inequality provides : 


= прад аге 


п апа р which in turn uniquely determine 


P{X-wl>c} < с2/с2 > P{IX-pl>10}< 200/900 = 2/9. 


Thus, the max prob. = 2/9 so that the upper bound to the probability is 2/9. 
Example 5. Let X ~ bin (n, p). Show that 


PiX np» ne} < SE le P hr eh = 0) SO (1) 
Deduce : P(IX —npl<ne} > 1, as n — © (2) 
Assume : orter ee ck ...(3) 


Solution. Write P(X = k) = p, For k > np + ne, using p + € = Ө, we have 


n 
À(k — n0) A(k — n0) 
5р. = Der Dep e m [1 « e] 
k » nO k»n0 k=0 


че zu р, e 
k=0 


=e "(q+ pe)". у m.g.f. of bin (n, p)] (4) 


©. е (e^ + pe*)}" =e ME {pe™ tge "y (1) 
We now utilize extreme right of (3) 


20 2 93 Bus 
pe^ ge 5 pq * e^? )* q(-Ap + e^ AT pe^ + дех” 


< (р+4)еб, [ip < Я (ii) 
Substituting from (ii) into (i) and noting that L.H.S. of (4) is P{X > n0), we get 
P(X » n0) < е7 +70 2g [Choose X = £/2] (iil) 
i.e. P{(X — np) > ne} x e 


Similarly: РХ —np<-ne}<e" 4 
P(IX — npl» ne] S267 50, as p yos, (iV) 


LE. P(IX —npl<ne) > 1, as n — о [by Neg-Rule] 
Note that the R.H.S. of (1) and (4) are identical. 
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Problems with Solutions Provided at the End of the Text 


1*. Bring out the fallacy, if any, in the following statement : “The mean of a binomial 
distribution is 5 and its S.D. is 3". 


2*. Show net m largest possible value of the variance of a binomial variate is n/4. 
3*. For a binomial experiment, show that if р is near zero, P(X > 1) = p. 


KK. For given values of x and n, consider b (x ; n, p) as a function of p and show that 
it is maximized where p = (x/n). 


5*. If X is bin (4, p), find E [sin (nX/2)]. 


6*. For a binomial distribution (B.D.), the mean is бапа S.D. is /2. Write out all the 
terms of B.D. 


7*. If X is binomially distributed with р = 4 and p, = 1.92, find the other constants of 
the distribution. 


12-50. Mean (absolute) Deviation 
For bin (л, p), mean = np, so M =E (IX-np l). 


M= 2 fœlx-npl= >, f(x) (пр- х) + XfG)G -np). 


x«np X»np 


0s E(X-np)- 2. F(x) (х - пр) = У, Ј(х) (х - пр) + LF) (х — np) 


x«np x»np 


We add these equations; write A = [np + 1] for the greatest integer function, and obtain 


Nm 2 E F(x) (x – np), (use x = xp + xq) 
A 


1 п Ripa’ * n n! p* Eu pipi g" x 
= М = ___—— SS ae ae CT 
2 Ei - mu - POI DIR x!x-D! сж x—D!x! 


n-x,x-l 


n = 
= Y(A, — A,,,), where A, = (npq) E a p 
X 
This finite series telescopes to sum A, [ A,,, = 9]. 


M = (2npq) dh ga. А s [np 1]. 


12-60. M.G.F and Ch. Function 


ма:х) -( per: Шаар 1500 88710] 


pat 2. 


р = мел Гек pe)" "€ l-o7np(a* P) 
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12-61. Central Moments through Central М.С.Е 
M(t vM a np) È ew M(t X) а e" (q " pe' )" i (qe ^" pe! p 


: . А t pe d ж 
Using exponential series е = X(0* / !), this reduces to 


4 n 
[ | 
М(ї:Х-пр) - + pq E DET “+ pa - spay. eval) 
We connect it with c.g.f. K(r). Thus 
К) = in M(t: X) -0n(M(t: X — np).e"" } = npt + n M(t: X — np) 
Using (i), this becomes 


2 p 13 
K(t) = ipt nine pub pa (a-p) $y pa – 3р4) т | 


We now use logarithmic expansion (n(1-- T) - T – (72/2) + (7/3) – 


> k, — = ү = mind pak + pala ni» + pa (l- эр) +. m мн.) +... 
Equating various coeffts. of (t)’, r = 1, 2, 3, 4, ... 

k; = np, К =npq, К, = npq(q — p), k, = пра (1 — 6pq), ... 
Recall : р = ky, i = ky, Hy = ky, Hy = ky + 3k; = kpq (1 — бра + 3npq), ... 
Standardized binomial variate : X* = (X —np)/Jnpq. 
A standardized binomial variate itself is never a binomial variate. 
12-62. Romanvosky Moments Recurrence Formula 

uw, , = Palarp,_, + (du, / dp)]. 

Proof. By definition, p, = E(X — np) 


e и, = X ("а р.х ов "Р Ee 3 (2) gw 
dy, m rper wm 
а (п) ча" eor 


D p Jep" gq’ * -(n- x) p'q' 7] G np) - nrpg"™* (x — пру!) 


x-0 


9L 


2:2 3.3 
pt pt t i,’ 
* ge" + pe" апер Er BE ненае, е.) 


Q 
a 
eh 

| 
| 


t? 
| = aP +a) = qpV(p + a) - 3pq(p + а) = pq (1 - 3pq). 


$12-62. Romanvosky Мотеп ts Recurrence Formula 3 9 9 


t n X Б, | X n-x 


n f(x)(x-np)'! 
2 pq 


Ш 


Ш 


—nr Y, f(x) (x ^npy!, 
x=0 


(pq) ! E(X - npy *! - nrE(X "py custo шы “пл. 


Ш 


Thus, by transfer, H,,, = pq[nrp,_, + (du,/dp)]. 
Note. Put n = 1, 2, 3, in succession, use p) = 1, H; = 0 to obtain 
H = pq [пио + Du] 2 пра. [D d/ dp] 
My = pq np, + Du;[- pq D(npq) = пра (а — p). 
M, = pq [3np, Du] = 3n pq? + пра (0 6рд). 
Example 1. Suppose that M(t : X) = (q + pe)", x = 0, 1, 2, ..., n. Find the p.m.f. of X. 


Solution. M(t: X) = Y (4) Gis we Jee Y (x) PERENA n Ea 


x= x=0 


However, the definition of m.g.f. provides M(t : X) = Le aJ) [Dirichlet’s Expansion] ...(2) 
Equating the general terms of (1) and (2) we obtain 
po = ey РО ЕО, 251m ех ~ bin (n p). 
Example 2. Using central m.g.f. of bin (n, p), prove that 
| OM/Ot = pq {nt M + (0M / Op)], [M = M(p, 1)] wt) 
| Deduce : И у = pqinrp,., + (du, / dp)). 
Solution. М = E[e'* P] =e™ (q+ pe)" = (pe" +qe")"=(T)", [T = pe" + дег") 
0M/Ot = nT". pale” —e'"] 
ӘМ /dp = nT" '[e" — e" —t(pe" + qe ")] = пт"! (e — ег") nT" 
= (pq) ! 0M / Ot - nt T" 


This yields : B = pq [2 ennt. st t) 


(ii) We differentiate (1) r times w.r.t. parameter t and use Leibnitz theorem of repeated 
“ifferentiation to obtain 


9'*!M 0 әм ә" М (5 дг | 
—— = =— + A . 
ar’?! гч} д" en eU 1 e ^! 


Pus = 0, use 0*M(0)/0r* = p, to set the last result as 
Hear = pq {(dp,/dp) + nrp, _1}. TRY 
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12-63. Cumulant Recurrence Formula 


Re | = pq(0k, /др). 5l T 


Def. K(t) = (n, M(t) = nin (q + pe’). 


t or K AK 
co В ы DE ede 2 = np+ pa S. = T 
Ot q + ре др q + pe VP 


Substituting Taylor's series for function K(t), viz. Ex,(r' /r!), this gives 


V OK, "d V E 


Op r! 


Equating constant term on both sides of (2) gives кү = np. Next we equate Coeff. of ffr 1) 
on both sides of (1) to obtain 


ERIS S 
= pq D(np) = npq, x, = pqD (npq) = npq (9 — p) ; K4 = pq D (npq (q — p)] = npq (1 ~ 6рд). 
кз (q-py K4 1- 6pq 
= —=——_,, =—— +3 = 23 
P, Kj npq P: к? npq 


ү, = УВ =@-p)/Jnpq, ү, =B, 3-2 (0— 6pq)/ пра. 
It maybe noted that the point (В,, B,) lies on the straight line В, — B, = 3 — (2/n). 
Exampl 1. If K(t) is the cumulant function of bin (n, p), show that 
d *dips- 
^ч = n[I- e **?] 1, where z — (n, (p! q). 
Further expanding the R.H.S. in powers of т by Taylor's Theorem, show that 
к, = nd pidr "SND р). 
Hence or otherwise obtain the recurrence relations 
K,,, = pq (Як, Гар) = (dK, | dz), (т > 1). 


Solution. By definition. K(r) = (n M(t)=0n(q + pe')" =nlng+ndn [1+ e'(p/ q)] 


= ninq- nün[1 4 e'**], (plq = е“, by hypothesis) 
Д.К gitl cheer 
Thus -e es {l+e y! (1) 


Further Parts. Let (z+ t) = [1+e"*? J", so that $(z) = (19e) =[1+(q/p)I = 


Now Taylor's series for ф(2+ /) in powers of t is, by (1) 


1 dK = 
E wdrene Due ДЕ LAE (2) 


RÀ 
r=0 ">; dz” 
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jating K(r = У (уу, 
Differenti g (t) X (t'/r ')k,, we get (dK/dt) = к -bi 
This reduces (2) to the form 
ud " r-| r-i 
k, " Em = п У 1 2 АР? 
r=! (r— D! 2 (71)! dz 


So К, = пр, k, 2n (3) 


Finally from (3b), 


/ =— + 
dz } dp dp p q pq 
n d'p n к=з 
ACT stl | === ; Ch 
x (de) melee [Change r to (r + 1) in (3)] 


Thus, К. = ра (dk, Гар). 
Example 2. Іп a sequence of n independent Bernoulli trials, let р, be the probability 


of an even number of successes. Prove the recurrence formula : 

Pe dpa ua (1 PBP = pEr RP Pah 
where p is the constant probab. of success in each trial. Obtain also the generating function. 
Solution. Let 5° = (Even number of successes in n trials}, 5, = (Odd number of 
successes in n trials}. : = {First trial is a success}. Now 


ESL Sa ud Ls “_, [Success followed by odd no. or failure followed by even} 
By Multistage p-Rule 
P(S*) = P(T,) FG; (ІТ) + PT) PCS. 1T) 
x XI — Bea +O РУ PP. v. 


To solve it, we put this in the particular form 
| | e 
Pn -1-«- »(n...-1) nal. gl 


So р = AP [A 24 - p, P, = p, - 3] 


n=l?’ 


Obvisouly, Р, = АР, _, eA RI, =..= МБ 


n 


AE n 
As P= Py - 3 = , this gives Py = +5 - Р) 


N|— 


оо 


п TN t n "m 
Generating Function : G(t) = 2 P t" = 7 [1 (q - р) ] 
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Problems with Solutions Provided at the End of the Text 

If X. i= 1, 2, 3, 4, 5 are independent point binomial variates each with paramete, 

, = 1 find (a) Р(Х =3/ 5), (b) P(X > 3/5), (c) (X <3/5). 

bh a X ~ bin (n, P) and P has the distribution dF p(t) = fp(t) dt, O € t € 1. Show tha 
if E(P) = р’, then E(X?) 2 n” yj. 

3*. Each of n independent variates X,, i = 1, 2, .., n takes the value 1 with probability 
p and the value 0 with prob. q = 1 ~ p. (X, are indicaters). Find the probability that 

J, ACA thet OX, zx when x= 0, 1,2, ..., n. 

4%. Let X ~ bin (n, p), Y ~ bin (n, q) be indep. p + q = 1. Show that X + Y is distributed 

like X, + X, +... + X,, where X, are i.i.d. variates with the Dist. : 


gp". 


/ P(X, 20) = pq, P(X, =) =p +g, Р(Х, =2)= pq. 
p. Find the p.g.f. of zero-truncated bin (n, р). Also obtain variance of such a r.v, 


12-70. Relative (or Pseudo) Binomial Variate 
Let Y be bin (n, p). Then X = Y/n, is the ratio of the number of occurrences X to the total 
number of trials n. The variate Y is called Relative binomial variate. Obviously 


P(X = х) = PY 2 nx) 2C, q'^" p" x - 0, L, 2, ИО elsewhere. 
Iss Б д. бей р": 


To domain of f(x ; n, р) is the set of (n + 1) points lying in the closed interval [0, 1]. It 
is also transparent that 


n n n n п? п? п 


Е(Х) = (ZED w. Var лар Var? пра ра 


Note. X does not have binomial p.m.f. since it is not an integer-valued variate. 
Example : Let X be Relative bin (5, 1/4). Find 


(a) P(X = 1/4), (D PX = 179); Cera = 275), cd) РХ > 1/2). 
Solution. Here n = 5, p = 1/4, q = 3/4 so that x = СОО: *3]5 45. 1). 
(а) Р(Х = 1/4) =0, since 1/4 does not belong to the domain of D. 


© 3 «Г, 
о 0700-8. 


(а) Р(Х 21/2) = P(X = 3/5) + Р(Х = 4/5) + P(X =1) 


Г 99 «99 -esn-a 


ИХ ———— SS 


1. 


3. 
4. 


8. 


Exercise 12(c) 4 0 3 
Exercise 12(c) 

Bring out fallacy, if any in the statements : 

(a) The mean of a binomial distribution is 5 and the standard deviation is 4. 

(b) The mean of a binomial distribution is 3 and variance is 4. 

If X ~ bin (n, p) and Y= X^, find Corr (X, Y). 

Identify the distribution with the m.g.f. (0.3 4 0.7 ey. 

(a) If X is bin (n, p) with E(X) = 5 and 0; = 4, find n and p. 


(b) If X is bin, with index n = 10, find the parameter p if P(X = 2) = + P(X = 3). 


(a) If X is bin (25, 0.2), show that P(X < p,- 20 ,) = (0.8). 

(b) If X ~ bin (100, 0.1), show that P(X € u Зс) = (10.9) (9/10). 

If X is bin (5, 1/2), verify that P(X <р.) = 1/2. 

Determine the binomial distribution for which the mean is 3 and variance 2 and find its 
mode. 


Show that the binomial distribution for which (mean + 2 variance) = 4, mean + variance = 3 
is bin (4, 1/2). 


~ Let X ~ bin (п, p). Show that the mean p and variance с? can never satisfy the relations po = 4, 
u y 


10. 
11. 


12. 


17. 


Slus 2. 


Let X ~ bin (n, p). Find n and p if po = 4 and p/o = 2. Hence find B,,B, and mode. 


The mean and variance of a binomial variate X are 4 and 4/3 respectively. Show that 
В, =a B, =11/4, x9 2 4, 8(и) = 640/729 and P(X 2 1) = 728/729. 


The meli and variance of a binomial variate X аге 16 and 8 respectively. Find B, B}, mode, 


mean deviation (u), skewness and kurtosis of the distribution. Find also (i) P(X = 1), (11) 
P(X = 2), (iii) P(X > 2) and (iv) P(X z 21 X » 0). 


5 
If the m.g.f. of a variate X is (1 + 2¢') , show that P(X = 2) = 40/243. 


If X and Y are independent bin (5, 1/2) and bin (7, 1/2) respectively, show that 
P(X + Y=3)=55/(2)'°. 
If X is bin (4, 1/2), show that P{ | X - 21 2 1} = 5/8, and compare it with Chebyshev’s 
inequality estimate. 
Use Chebyshev’s inequality to determine how many times a fair coin must be tossed in order 
that the probability will be at least 0.90 that the ratio of the observed number of heads to the 
number of tosses will lie between 0.4 and 0.6. 
If X is bin (40, 1/2), use Chebyshev’s inequality or otherwise to 
(a) Find k such that P (1X -201» 10k) <0.25. [K^ = 4/10] 
(b) Show that a lower bound for P { ! X - 201 <5} is 0.6. 
(c) Find the upper bound for P( ! X ~ 101 > 10) З 
[For (c), use P( 1X - bl» c) < E(X - b'/c^. Here p = 20, o! = 10, E(X - 10) = 110, 
bound = 110/100 > 1, a useless bound] 


- Assume that you have a fair die. How many times should you roll it (what is the least number 


of tosses) so that with a probability of at least 85% the frequency of 6's will differ from 1/6 by less 
than 0.03 ? 
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19. 


20. 


21. 


22. 


23. 


24. 


29. 


30. 


31. 


32. 


33. 


You have a die but you do not know whether it is loaded ET m E E times should Yo 
roll it so that with a probability of at least 85% the E. ч j's will differ Mes 
actual (but unknown) probability of getting a 6 by less than 0.05 : | 

ns їп ап air conditional compartment of a railway Сапа» 

llows a binomial dist. with p = 0.06, Fop, T 

d for each vacant seat there is a ney b. 


There is accommodation for 5 perso 
The number of accepted seats in this carriage fo 
seat the railway have a net income of Rs. 50/-, an ij А 
Rs. 15/-. Find the average net gain for the railway by running this carriage. 
A quality control engineer takes daily samples of 10 electronic fenipenents and check; them, 
for inspections. On 200 consecutive working days, he obtained L 12 samples With zer, 
defective, 76 samples with one defective and 12 samples with two defectives. If these samp 
can be looked upon as samples from binomial population, obtain the theoretical OF expected 
number of samples with zero defective, one defective, and 2 or more defective. 

If the probability that a child is son is p, where 0 <р < 1, find the expected number of sons i, 
a family with n children, given that there is at least one son. 

Determine the expected number of boys in a family with 8 children, assuming the sex 
distribution to be equally probable. What is the probability that the expected number of 
boys does occur ? 


асђ 


$ of 
I 


The probability that a defective soldered connection is made on any given connection is 
1/10°. Find the expected number and S.D. of defective joints in a system with 5 x 10 
soldered connections. Also find the probability that there are no defects in the system. 


If X is bin (n, p) show that X is symmetrically distributed about c iff p = 1/2, c = n/2. 
Х|, X», X, are independent Bernoulli variates each having the parameter р = 1/4. Show that 


@) Р(УХ, = 2) = 9/64 (b) P(X <1)= 63/64. 
X,, i= 1,2, 3, 4 аге independent Bernoulli variates each having the parameter p = 1/2. Show 
that (a) P(X 23/4)21/4. (ЫЬ) P(X >3/4)=1/16. 
Determine the binomial distribution when 
(a) В, 21/36, В; =35/12 (Ы) В, =1/15, В, = 89/30. 
[Ans. (а) bin (18, 1/3) or bin (18, 2/3); (b) bin (20, 1/4) or bin (20, 3/4)] 
If X is bin (n, p) show that 
(a) P{X is even} = (1/2) [1 + (9 – p)']. (b) k; = пра (q — p) (1 — 12 рд). 
If X is bin (n, p) prove that Recursion formula 


opn-xel 
fo» d а и "o ОЕ ртд) 


If p = 9, this reduces to the form f(x) + f,(x- 1) = Zh (x) 
as 103). 


Using the factorial moments, or otherwise, prove that ү, =0 => p orq-i(l 41/49) 


If X and Y are independent bin (n,, p, 
distribution of X + Y if p, 2 p, ? 


А PES 
) and bin (n, p,) ; find Р(Х + Y = k). What ^' 


If X and Y are two i.i.d. binomial variates, obtain P(IXYIz р), ғ: positive integer- 


x 
If X is bin (n, p), show that P(X <x) = | [> —JX —— à y 
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34. Ifa random variable takes values 0 and | only; show that all its moments vom 0 are equal. 

85. LetX- bin (1, ру) г and Y ~ bin (1, р„) be independent. Find the density of Z = XY. Verify your 
answer by calculating the mean and variance of Z by two ways. 

36. Let X be bin (n, p) and r be a non-negative integer. If the rth moment about the origin is 


denoted by д, —E(X"), prove that 
Hh. = npp! + pqdy'/dp. 


12-80. Miscellaneous Worked-out Problems 
Example 1. If X and Y are independent Bernoulli variates with parameters 1/2, show 
that X + Y and | X — Y | are dependent though uncorrelated. 
Solution. Here P(X = 1) = 1/2 = Р(Х = 0) ; P(Y = 1) = 1/2 = P(Y = 0). Let $2 X + Y 
and D =| X — Y |. The distributions of S and D are easily seen to be 
Р(5 = 0) = 1/4, P(S = 1) = 1/2, P(S = 2) = 1/4, P(D = О) = P(D = 1) = 1/2. 
fi 0, = 0) = P(X =0, Y=0) = P(X = 0) P(Y = 0) = 1/4. 
me 0) = P(X = 0, Y= 0) = Р(Х = 0) P(Y = 0) = 1/4. 
ШОШО =X = 1, Y = 1) YPC 0, = 0) — 1/44 1/4 =1/2. 
POS =0, D=0) = Р(5 = 0) P(D=0) = Sand D are dependent. 
Now, E(S)=0.1/4=1.1/2+2.1/4+1, EWD)=0.1/24+1.1/2=1/2 . 
< Cov (5, D) = E(SD)- E(S) E(D) = 1/2-1/2=0 = Sand D are uncorrelated. 


Example 2. Show that E(X +a)! =Í i G(t) dt, a>,0.. | TA 
Find it when X ~ bin (n, p) and a = 1. Also evaluate bias of Y = (n + 1)/(X + 1), as an 


estimate of (1/p). 
Solution. Formally : G(r) = E(t’), so 


v (a+ х) 


ои =] ze Fix) |а fy ak с IS Sx +a)! 


For bin (n, p) G(t) = (q + pt)" and with a = 1, Eq. (1) provides 
1 1 п DM 1 n+l i "m ]-4"*! 
Exi] E i (q+ pt) dt = pp ila Pa n "ГЇ it) 
Bias = E(Y) — (1/p) = (n + 1) EX + D! (Ир) = –(4"* 4p. (by DI. 
Obviously, bias — 0 as n > œ, since q” > O as n > o,0 «q« l. 
Example 3, Let X,, X, ... X, be i.i.d. bin (1, 1/2) variates. Find P(Y = 0, Z = 1) where 
Y= min {X,, .., X.) and Z = max (Ху... Xp). 


Solution, Let A = (Y = 0} and B = {Z = 1) ; then A = (Y = and B = (Z 40), (ANB =Ø) 


P(A) = P(min (X,, .., X,) = 1] PAX, =1,... X, 71) - U(X, = 1)]" =(1/2)". 
P(B) = Р{тах (X,, ...,Х,)=0)= P(X, =0,..., X, =0)= [РОХ = 0)1" = 1/2)". 


ni 
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P(AB) = 1 Р(АП В) =1— P(AUB) =1-[P(A) + P(B)] 

= 1—[(1/2)" +(1/2)"}=1-(1/2)""'. 
Example 4. Simple Random Walk. A drunk performs a random walk over position. 
0, +1, +2, ... as follows : He starts at 0. He takes successive one-unit Steps, going tp 
the right with probability p and to the left with probability q = 1 — p. His Steps are 
independent. Let X denote his position after n steps. Find the distribution of 
Y = (X + n)/2 and Var (X). Also find P(X = 0). 
Solution. If X, is the ith step (movement), then by hypothesis Р(Х, = 1) = p, and 
Р(Х, = -1) = 9. Let X = X, +X, +... +X, ; then-n<x <n. Now 


G(t: X) = Ee") = pr qr. 
Glt : (X + ny2] = С: X) = p"? (Gt: x Y =r (pvt +.q/ AT)" = (а + pt)’. 
This shows that Y = (X + n/2) ~ bin (n, p) ; the distribution sought. Now 
E[X + n)/2] = пр, Var [(Х + п)/2] = пра => E(X) = n(p - q) ; Var (X) = 4npq. 


Now р, = Pa =0)=P(y=2)=( i] pq". 


n(n — D) ...(3n 4 1) 
Thus, Po = SUPE SEEN 


This is the probability that the drunk shall be at the origin after n steps. 
Example 5. If X ~ bin (n, p) and Y ~ B, (k, n — k + 1), then Еур) = 1 — F,(k — 1). That is 


P{X 2k} = [B(,n-k* D" fru" (12 u)" * du ETT] 


(pq)'" if nis even; py =0 if n is odd. 


Deduce : P(X2k) < (1) р" ; 


Solution. We differentiate w.r.t. ‘p’ the survival function P = P(X >k)= Y (5 q''p 
dP T n-r r- n| n-r-l,.r N NI. ^ 
E Eee menm] |е=9(8)-"(".) 
Y n=1) а гы A n-1 gm р" | 

r=k d dui. : i " 


-n XC (7—1) – 0). [ «(^ ) 4" р", фт) = o| 


"^ - - -] - n-k 
= пе) Фа п (1) am (tin '1- р)". 
Integrating this result on [0, р] and adjusting dummy, we get 


ee (en) nocent o 
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снет 


n-1 n! I 
n "NN (n+ 1) | 
No | К s (k-1D!(n-k)! ГОК) Ги - К+ 1) B(k,n — К+ Y) 
So, using (3) into Eq. (2) yields the stated result (1) : viz. РҮ p] & P(X » Kk]. 


n-k 


Deduction : u>O => 1-и<1 => (1-и el, 


у un du - [4 p". 


Example 6. Let X ~ bin (n, p). Show that 


"^ —k n dr s pt m A 1 P B NEP LL. і 
P(X € k) = (п ШУ t (1-0) dt=1- AEAN EI „га t) dt. 


‘ AUS 6 { р tt- " 
Deduce : RXS К) = Bulimia bans 
n! Г(п+ 1) 1 


ion. Ob : (n-k)| 7 ren aanre Ly, BCE ci ney 
Solution. Observe : (n "m k!(n-k-1)! T(ke-DI(n-k) В(К+1,п—К) 


эш 


(i) Now F(k) = P(X<k)= Ў Күз 
r=0 

Differentiating (2) w.r.to q we obtain 

dF k HM H- PET 

& - Ele emn 


E Herren] et) 


r=0 


k A a E л 
2 let) -or - D}, |а|" Ja 1 


no(k) _ [ф(—1) = 0] Telescopic Series. 
Integrating both sides w.r.t. д between limits [a, 4], we obtain 


[F(k)] = (^ | [re p da (n- (1) jt a-o at 


242) 


(2) 


63) 


Where the dummy variable q is replaced by dummy variable г and р by (1 — t). 


Bean a = МАЕ af а= | Uu DP oy а 


= B(k*ln-b-f'zü-2""*"da [z-1-1] 
From (3) and (4) using (1), we obtain 


Fk) = 1- acre tiara welt Neate 
(0) P{X>k) = 1- РХ <} =1- Р{Х<К- 1) 


=(Bik,n-k+iy' [7207101 0)" а. (Бу G)] 


FTN 


(4) 


i. (8 


(б) 
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Example 7. Let X, ~ bin (n, ру) and X, ~ bin (n, p;). If p, < р, show that 
P(X, < k} > P(X, < k}, fork = 0, 1, .., n. 
Solution. The relation between binomial and beta distribution 
| 


P шу] № 
Р{Х> ғ) БЕШИ X (1 — x) dx. Xt 


S 


P(X <k) = 1- PX» k)-1- Р(Х>2к+ 1) = 1-[В(6 +1, п К fx (0-23 dx 
or fx'a9" "dx 2A[I-P(X«]. [А = B(k-1,n-K).[r k1] ...(2) 


If p; > ру, then f? f(x)dx> |" f(x) dx. [f(x) = x* (1 х)" ^^^! ] whence 

AI - P(X, S y A[L—- P(X, S &)] > PX, & k) Р(Х, sk). Fik) > Fk) 
[The smaller the p,, the more the binomial distribution is shifted to the left]. 
Example 8. Let X ~ bin (n, p). Show that 


k k 
P(X <k) = А] pou ы, where pap 29 2 —. BR, n-i). 
plq (1+ y)"* À 0 (1 dg y)"* 


2 Эа 
Solution. Since Р(Х < k) = | US s 


d А п n-x- К П | n-x,x- 
"Pid one = 2 MET p -x(2)a p | 


é — 1 n-x- x di n-x.x- 
У e Ja p (ja p | 
х=0 


= У њод x 0600 ео)" Jay. ac =0} (1) 
x=0 
"EU bigeye WR p ГАШ f (п-т 
P = 8 дан анан Mc air ner Е 0 k 
d oo y*dy "m Ap! qy E ы н РЕ! n: (k) [by (1)] 


dq “юе (ү+уу*! — [ї+(р/ФЇ'! 4 


k 
Thus d P(X €k)-X 3 oe: МЕ = 0. We integrate it to get 
| dq plq (1+ y)"*! 


P(X<k = rf" [Y D 
- plq (та 59 d 


the constant of integration vanishing when q = O. 
Remark. P(bin (n, p) < k} = P{B,(k+1,n-—k)2 p/q}. 
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Example 9. Independent binomial variates X; (i = 1, 2, ..., k) have parameters n and 


p; Find the mean and variance of X=X,+...4 X, and compare these with the mean 
and variance of a binomial variate Y with parameters nk and p = >(p/k). 
I 


Solution. Since X, ~ bin (n, pj, we know that E(X) = np; Var (X) = npa, so that 
E(X) = E(X,)+E(X,)+...+E(X,)=n(p, + р, +... + р) = nkp. 
Var (X) = Var (Х|) + Var (X,) +... + Var (Xj) = n[p,q, + p445 +... + PLA 


= nlpq,-nIp;(0— p) = n(Ep,) -n (Ep?) =nkp — пр} 
Now E(Y) = nkp, Var (Y) 2 nkpq 


Var(X) _ npk-nEp; 1-[(5р2)/ рк] 
Var (Y) Кир MR q 


k 2 EL 4 2 2 
From D Р) = Sip tkp 0,2 mae pet 1-12) 1-р 
isl i=] kp kp 
Var (X)/Var (Y) < 1, i.e. Var (X) x Var (Y). 
This result is somewhat unusual. 


Problems with Solutions Provided at the End of the Text 


1*. Show that if two symmetrical binomial distributions (p = q = 1/2) of degree n 
(and of the same number of observations) are so superimposed that the rth term 
of one coincides with (r + 1)th term of the other, the distribution formed by 
adding superimposed terms is a symmetrical binomial distribution of degree (n + 1). 


2*. Random variable X is bin (n, p) but the parameter p takes one of the two values p, and p, 
with respective probabilities Ө and 1 — Ө. Find the probability that X = л given X > 0. 


3*. The failure rate of a new process is estimate at 7596. How many times should the 
process be run to given an 80% chance of at least two successes ? 


4*. For one half of л events, the chance of success is p, and the chance of failure 
is 4, whilst for the other half the chance of success is q, and the chance of failure 
is p. Show that the S.D. of the number of successes is the same as if the chance of 


success were p in all the cases i.e. Jnpq, but that the mean of the number of 
successes is n/2 and not np. 

* Show that р’ = (рд/ др)“ (q+ p. 

Let (X, Y) have joint p.d.f. 


(1 — 0) 0’ fep Ie» Е 7:6 х(1-у)+ 01 x) 3d e 
ovp «а Өте 0x0 


where x 20,1;y20,1;0x9,0' <1. 
Find р(х) , f(y) and Corr (X, Y). 
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Miscellaneous Exercises 
With the usual notation, find p for a binomial variate X when л = 6 and if P(X = 4) = pry -> 
è А А • b РА - d) 
X is a binomial variate with mean 6 and variance 4. Find n and p. Hence evaluate 


(i) P(X > 15), (ii) P(5 < X < 10), (iii) Р(Х < 8), (iv) P(X > 6), (v) P2x X < 12), (vi) PG x - 16 
and P(X =41X>0). < 16) 


In a binomial distribution consisting of 5 independent trials, probabilities of 1 and 2 SUCCesses 
are 0.4096 and 0.2048 respectively. Find the parameter p of the distribution. 

For a Binomial distribution the mean is 6 and the standard deviation is V2. Write Out all the 
terms of the distribution. 


Let X be bin (2, p) and Y be bin (4, p). If P(X = 1) = 5/9, find P(Y = 1). 


" . . 9 
If the т.о. Ё. of a variate X is (2 + 5 е!) find P(X = 5 ог 6). Also show that 


P(—20<X<p+26)= їз H an PANE 


Let X be the number of successes throughout n independent repetitions of a random experiment 
having prob. of success p = 1/4. Show that the smallest value of л so that P(X > 1) > 0.70, is 4. 


84 Let the independent variates X, and X, have binomial distributions with parameters n, = 3, 


p, = 2/3 and n, = 4, р, = 1/2 respectively. Compute P(X, = X,). 


Let X ~ bin (n, p). If F(x, n, p) is c.d.f. of X then show that F(A, n, p) > 1/2 if p < 1/2 and A = np 
is an integer. 


10. Let X ~ bin (n, p). What is the distribution of n- X ? 
М., Let X, ~ bin (лу, p) and X, ~ bin (п,, q) be independent. What is the distribution of X, — X, +n, ? 


ax 


14. 


16. 


17. 


18. 


If X ~ bin (n, p), show that P(X < 2) = P(X 2 n- 2) iff p = 1/2. 

In a sequence of independent trials, the probability of an event A varies cyclically through 
values p, p +8, p- ô, p +ò, ..., where0<p-—d<p<p+t+sé<l. 

(a) Find the probability of observing r A's (exactly) in 4 successive trials. 

(b) Find the mean and variance of the distribution of r, and compare with the corresponding 
values for a binomial distribution with probability p. 

A machine usually makes items of which 4% are defectives. Every hour, a sample of size 10 
is drawn for inspection. If this sample contains no defectives, machine is not stopped. Show 
that the chance that the machine is not stopped when it has started producing 10% defectives 
is (0.9)'°. 

If X ~ bin (N, p) and if N is allowed to vary, then show that E(X) = p E(N) and Var (X) = p EV) 
+ p, [Var (N) - E(N)]. 


2 
Let Х|, X,, ..., X, be i.i.d. bin (1, p) variates. Find the p.d.f. of Y= M „Ж. + A, 


The prob. p, that n persons visit a supermarket in one day is p, = qp", n = 0, 1, 2, ... Lt 
of three persons, on average, buy an item D. The prob. that D is defective is 1/4. ER ional 
(a person buys a defective D) = 1/2. If k non-defective items are sold, show that the conc! 
prob. r, that n persons visited the shop is 


r, E "a p'** (d ^" yon. 


If X ~ bin (n, p), prove that: Е[(1+ X)! ] [L2 g"*P]/ (n+ Dp. 


49. 


d 


20. 


„%21. 


— 22. 


23; 
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al ee n+2 4 4 
Е[1 + X) 2+X)']=[l-q ** — (n 2) рд" *!]/ (n+ D (n+ 2) p°. 
Let the zero truncated bin (n, p) be defined by 


Р(Х = х) = "С, pg" "(01-q"y', xz12,..,n; Р(Х=0) =0, 
Show that the negative moments M , = E(X“),k =1,2,...,M, = 1, satisfy the equations 
ЙМ ү AM M,-, 
аа 41-9) 41-9) 


Hence obtain the lower moments. 


k k | 
Let X be a binomial variate and let В (k; n, p) = У, Р(х; п, р) = >, (") wa 
x20 i 


x=0 


Show that the following (tail-probability results) hold 


b (k; n, i 
HAS Riel old n ET ышым (ЬУ Bü р) Tp b (kn, p), k «np 


(a) 1- B(k — 1, п, р) < 
np np 


(c) 1- Bin р) =n) [е 0)" а. 


Ten students are chosen at random from a college at which 20 percent of the students do not reside 

in the college compound. Find the probability that exactly 8 of the students do not reside in the 

college compound. What is the expected number of non-resident students in the sample ? 

The probability of team A winning any game is 1/2. What is the probability that A wins more 

than half of its games if A plays n times, when n = 2m+1,n=2m? 

If a fair coin is tossed at random five independent times, find the conditional probability of 
heads relative to hypothesis that there are at least four heads. 


. The probability that any of л identical units takes part in an experiment is р, (p 1/л). If a 


2 


given unit participates in the experiment exactly k times, the result of these experiments is 
considered attained. Find the probability of attaining the desired result in m experiments. 
Find also the prob. of attaining the desired result in (2k — 1) experiment, if the experiments 
are discontinued when the result has been attained. 

Two independent sequence of independent trials are performed. The first sequence consists 
of n, trials and the second consists of n, trials. The probability of a success on any trial in the 
first sequence is p, and on any trial in the second sequence is p,. What is the probability of a 
total of k successes in the combined trial ? 


26-7 If in a Bernoulli sequence of n trials, it is known that there are exactly k successes, what is the 


27. 


conditional probability of a success on jth trial ? 
Two dice are thrown n times. Let X denote the number of throws in which the number on the 
first die exceeds the number on the second die. Show that X is bin (n, p) where p = 5/12. 


28 Suppose n numbered balls (1, 2, ..., n) are randomly distributed among л cells, also numbered 


1,2, ..., n. If X be the number of matches, show that X is bin (л, 1/n). 


29° Starting at the origin a particle takes steps of L-units length, to the right with probability p 


and to the left with probability q = 1 — p. Assuming independent trials, find the probability 
after N steps and also variance of the distance. 
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30. 


31, 


32. 


umber out of fifteen called between 2 ру 


ssume verage one telephone n E 
Assume that on the averag that if six randomly selected teleph 


3 P.M. on Sunday is busy. What is the probability 
numbers are called 


and 


One 


(a) not more than three, (b) at least three pF them will be ea 
The probability that a unit must undergo repairs after k accidents Is given by the formula 
flb=1-(1- 1/0), where Ө is the average number of accidents before the unit is submitted for 
repairs. Prove that the probability that after n cycles the unit will need repairs is given by 
P, = 1 -(1— p/0)", where p is the probability that an accident will occur during one cycle 
A point A must be connected with 10 telephone subscribers at a point B. Each subscribe, 
keeps the line busy 12 minutes per hour. The calls from any two subscribers are independent 
Find the minimal number of channels necessary, so that all the subscribers will be served а 
any instant with probability 0.99. | 

Independent binomial variates X; (i= 1, 2, ..., k) have parameters л and p'. Find the mean and 


Var. of X = E(X; / k) and compare these with the mean and variance of the bin [n, E (p//)], 


The opportunity God sends does not wake him up who is asleep. 


еы е е е н йй rie н эр н sie эн эрэн эн eoi de ее цеце 


We are all born mad, some ever remain so. 


Poisson Distribution 


13-10. Random Processes, Counting Processes, Poisson Distribution 
1. Definition : A random process is a family of variates (X(r) : t € T} defined on a 


given probability space S, indexed by the parameter t є T, where T is the parameter 
set of the random process. 


Since a г.у. is a function defined on S, it follows that the random process (X(1) : t € t} 
is really a function of two arguments : precisely {X(t, о), t € T, o є S}. For a fixed 
t (= t), X(t,, ©) = X,(@) is simply variate X(t,), as о є 5. And for a fixed o; є S, X (t, o) 
= X (t) is a one-variable function of time г called a sample function. If both arguments 
are fixed, X (t,, о.) is simply a real number. 


2. Definition : A random process (X(r), t 2 0) is said to be a counting process if X(t) 
represents the total number of events which have occured in the time interval (0, 7). 


The counting process X(t) must satisfy the following requirements : 
1. X(t) > 0 and X(0) = 0. 
2. X(t) is integer-valued function. 
Bn) 2 X(t.) if t» t. 
4. X(t) — X(t,) = Number of events that have occured on interval (t, t). 
3. Definition : A random variable X is said to be a Poisson variate (or X possesses 
Poisson distribution) if its probability law P(X = x) = f(x) is specified by 
Дх) = e> /x!, x=0,1,2,...,0, f(x) 20, otherwise dh) 
The constant А > 0 is called the parameter of the distribution. Obviously 
a 
x! 


=e *e* =], 


ENS at 
x=0 x=0 


The c.d.f. is Рх) = PX &x)  Zf(f t&x. 
Note. The parameter А = E(X) = Var (X) [8 8-31] 
Poisson trials, These are characterised by the following facts : 


l. The result of each trial is classified into two categories : say success (5) and failure (F). 
2. The outcomes of any trial is independent of the outcomes of other trials. 

3. The probability P(S) varies from trial to trial. 

4 


The series of trials is performed an infinite number of times. 


414 Generating Functions (or Transfer Methods) _ 
Poisson Counting Process | | | 
Any process which obeys the following five assumptions is called Poisson Counting Process . 
A, : The number of successes during non- -overlapping time intervals are independent variate, 
A, : The number of successes depends on the length of that interval. 

A, : The probability that a success occurs during the time interval (t,t + At), Ar<] is 


A. At, except for infinitesimals of higher order, with A = constant. (A > 0 is called 
rate or intensity). 


A, : The probability of obtaining more than one success during time At is negligible. 
A. : Let f,(t) = P {in time t exactly k successes occurs] : then 
fy (0) = 1 (at the start г = 0, it is certain that no success has occured), 
f, (0) 20 fork 2 0. 
[Note. X At— 0 аѕ Лг > 0] 


13-11. Derivation of Poisson pmf through Poisson Counting Process! 
In order to have k successes in time Г + At, we must either have k success in time ; 
followed by no success in time At (with prob = 1 — А At), or k — 1. Successes in time: 


followed by a single success in time Ar. We need not bother about having two or more 
successes in time At [by A,]. Hence 


f, t AD = f. (0l ААДА foa) Аг BOT AO La pM 0 
Letting Аг — О, we get the differential-difference equation : 
Df, (t) + M, @).. = АЖ... O, k =0,1,2,...(D=d/dt). ...(I) 
We need solve this equation, subject to the conditions 
f4(0 = 0, У 1; 300) =1, k>0; f,(0) =0,k>0. 
Assume the solution of (1) is given by the power series : 


ба, 0) = È f, (t 2) 


Since У, rA =1,(k= 0, 1, ...), the power series is Jeon convergent for 0 < Ө x 1. 
We multiply (1) by ө“ and sum over k = 0, 1, 2, ... to obtain 


Y Df(00 «4X f(09 = X90Y F_ (or! 
k=0 k=0 k=0 


i.e. “к „м; = эб. op Тр, è ET d 0*, formal 
t 


G Ot Ot ко 
A simple integration provides : (п G(r,9) =A (Ө — ])r + A(const.) 
At 120, 00,0) = У A0 = (0)=1 = A=tn ()=0 


+ The reader may skip over §13-11 on first reading. It is not used subsequently 
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~ -À Or -À E (ОЛУ 
G(t, 0) = ac SN =e = > а an vili) 


Comparing (2) with (3) we find that : f(t) = e " Qu) / kt, k =0,1,2,... (4) 


For t = 1 (Unit time), this 15: f, = е^ А/к! (Poisson density), k = 0, 1, 2, ... 
Note. Equation (4) is called Two-Parameter Poisson density. 


Problem. Prove that, under certain conditions to be stated by you, the number of 
telephone calls on a trunk line in a given interval of time, has a Poisson distribution. 
[Hint : Art 13-11]. 
Illustration. Let Z, j = 1, 2, ..., be i.i.d. variates with p.m.f. = P(Z, = 1) = р, P(Z, = —1) 
= 4, (р + 4 = 1). Write 
24590, X mZ ++. it Z, п=1,2,3,. 

The family (X,, n 2 0} is a random process, called simple random walk X(n) in one 
dimension (notated : RW). Describe the simple RW, X(n) and construct a typical realization 
of X(n). Find Var (X, ). 
Approach. The simple RW, X(n) is discrete-state random process. The state space is 

= {..., 22, -1, 0, 1, 2, ...} and index parameter. Set Т = 10:12...) Ие, пит, 
Sample Sequence. A drunk moves оп а line with unit step forward with probab p and 
a unit step backward with probability q = (p + q = 1). The format is 


n "mU 1 2 3 4 5 6 7 8 Qe dia 
Probab : p q q p p p q q poi is 
Eo e o0 1 Qua qUE LE d) 1 353 393 LA Dos = 3E 


[The second row indicates his forward or backward steps and the third row indicates 
his position after his movements]. 


Now EZ) Dp «caes p q, E(ZZ) = (p + -1q =p+q= | 
Var (Z) = E(Z7)-E°(Z,) -1- (p- ay = 4р. 
E(X,) = E(2Z,)=nE(Z,)=n(p- 4) 
Var (X,) = Var(2Z,)=n Var (Z,) = 4npq. 


Note. When p=q= 1/2, E(X,) +9, Var (X,) = n. 
Comments. The simple RW, X(n) has a Markov Property : Future is built on the present, 
not on the past. We show it 


P(Z,-k) = A, (k=1, A =p, ke - Ll AL =4) 
PIX.) =i,,,1Xq 20 X =й... X mi) = РІ, +1, 4,110, X =й, X =) 
a P(X.) * Фя = і, } 


because Z, , | is independent of Хо, Х|, ..., X,, these covering only Z,, ..., Z,. This shows 
X, + ı (future) depends on X, Ao pam ^v. is independent of X,- p Xp => X, Xo (past). 


= A, 


In | 7 !n 


= P(Z 
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13-12. Worked-out Problems \ 

Example 1. Given а Pois (A), find the cumulative probabilties of (a) no occurre wh 
(b) k or less occurrences. Write also expressions for P(X = k) and hence show tha 


Р(Х> п) – Р(Х>2 п + 1) = Р(Х = п) 
Solution. Recall that P(X = r) = fir) = [e^ X /r!], 10,12... 
(a) P [no occurences] = Р(Х < 0) = P(X = 0) = e? 


k k А 
(b) P(X<k) = (бх) о т E) ЯУ, 
r=0 r=0 en 
© © H © A 1 
(с) P(X2k) = p( Gx=n}- Y /0)=е * L E) (2) 
r=k r=k = : 
or Р(Х STEP ЕИО, 1. ...(3) 
Replace k by n and (n + 1) in (2) to obtain 
Ü op f > © r m AC 
P(X >n)- P(X2n+1) =€ X BE sd АХ = п). (4) 


Note. The result (4) is true for all discrete distributions. 
Remarks. P(X20) =1-P(X <0)=1, Р(Х>1)=1- P(X <l)=1-e”. 
P(X > 2) = 1- P(X <2)=1-e"(1+A), P(X 23) =1- P(X <2)=1-e "(1+ m+ m’/2!) 


P(X < 1) = e*(1-A), P(X $2)=1-e" Vel ig 


Example 2. If X ~ Pois (A), show that P(X < x)= г. 709и E A „х> 0. a. (1) 


Г(х pr 


Eb ro 
Solution. Let I, zi еч‘ dt. [Incomplete gamma Integral] 


In = f; € dt=e" = 0) 
Now we integrate by parts to obtain 


v o е гаа Е eh 
Е: E *h eit arth 


f(k) = 1, - IH. Ak) = e^ (А) ук! 


" TM= 
“Rng. 
Г аы 
= 
1 


> С. = h-1)=1, - Io =1, – f0) 


D 
tad 
ках 
| 


е Ч 051, |. [Result (P 
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Example 3. The number of events X in the interval (0, t) is Pois (Art)-distributed but 


each event has only a probability p of being recorded. Find the distribution of the 
number of recorded events Y. 


Solution. Recall : Р(Х = r) = e" (Aty Irt, r=0,1,2,... We utilize multistage p-rule. 


Р(Ү=к) = X PW=kIX=n)P(X=n=¥ D 
"en Ki r! 


AAD S A" | 
Rot Ner [Put r-—k =j] 


— 


e" (pat E 
k! | 


j=0 J 


е ptus (pAr)* | y (q а 
k! j 


= (е Py (pAt)* / k! 
Thus Y ~ Pois (pat). 


Problems with Solutions Provided at the End of the Text 


1*. The r.v. X has Poisson distribution 


(a) If (1) = (2), find ДА). (b) If 2&0) + K2) = 2f(1), find EOO. 
(c) If (2) = 9f(4) + 9046), find E(X). (d) If X ~ Pois (1), find P(X > 21X < 4). 
2*. If X ~ Pois (A), show that P(X > 2) = fixe" dx. (1) 


3*. If Pois (A) is so modified that the values X = 0, and X = 1 cannot occur, find the 
p.m.f. of the 2-pt truncated distribution. 


4*. If X is Pois (A) and k, r are positive integers such that k < r, prove that 
Y n? P(X = п) = X P(X 2 r - А). 


55. If X is Pois (A), show that lim P(X 2r1X27r)21,720,1,2,... 


roo 


6*. If X is Pois (A), show that lim P(X =r1X 2r}=1,r =0,1,2,... 


7*. If X ~ Pois (A) and P(X 2 s) = X f(x), S= X P(X2 s), prove that 


S 2 (1 — к) P(X 2 k) + AP(X 2k - 1). 


8*. If X is Pois (A) and discrete variate Y has the p.d.f. 


P(Y- riX = х} = (pa, 0«pclpsq-l 1 O<rsx. 


Show that the unconditional distribution of Y is Pois (Ap). 


Methods) 
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10. 


Exercise 13(a) 


Let X be a Poisson r.v. Write P(X = @) = fia). 


(a) If (0) = fll) =k, show that k =e”. (b) If f{1) = 2f(2), find AK) 
(c) If 0.01) = 0.1, 2) = 0.2 find f(0) (d) Iff(2)= 3701), find f(3).. 


(e) Iff0)=2f(1), find P(X 2 2). (f) 2f(2)=3f(1) + 10/(0), find P(0 « x <4 
[Ans. e^ / kt, f(0) = (1/2)39/99. (32/18), 1(3/2Ve)| 
If X is Pois (А), à > О show that : 


(а) P{X = even) = e^ cosh А -i( ету 


(b P(X =odd}=e™ sinh À = 1 (1 - e^). 
(c) f(x) = f(x + 1) for some integer x > 0, А being an integer. 
(a) If X is Pois (A), find the distribution of (-1)*. 
(b) Let X ~ Pois (A). If f(x) = fix + 1) > 0, what value must A have ? 
[Ans. е^ cosh А, (X even); e ^ sinh А (X odd). А = х + ] 
(a) Let X - Pois (A) and F(n) = P(X € n). Show that 


Lit () = AF(n-D, Yr2f(r)=22F(n—- 2) + AF (n-). 
r= r=0 
(b) Let X ~ Pois (A) and Y ~ U(0, D [Ду) = 1, 0x y x 1]. Show: 


P(X =0)= P(0«Y <°). Р(Х =n)= P(F(n-1) «Y < Е(п), п>1. 

Show that if f(x) = (4/x) Дх - 1), x= 1,2, ... then f(x) = e^ 47х10 € x « o. 

Let N be a fixed integer and X > 0 be a constant. If X is Pois (A), show that 
1рух+2<Х<а+1+М}< Y PUE E) (0+2) Pla 42« X «a 17 Л) 
A bet (Oth (w+) — 
If X is Pois (A), Fy and f, its c.d.f. and p.d.f., then for fixed x 

(a) f(x;A)=(A"/x!) РО, А) [f(x, À)s f,, F(x, А) = Fy] 

(b) df(x;A)/da= }(х — 1,5) – f(x;d) 

(с) SAAE- ХУР; А) = AF(X 1,2), у=01 


If X is a Poisson variate with parameter A, and integer г = 0, |. 2 how that 
=0, 1, 2, ... show tha 


а РОА 
P(X»r) = гур ! dt. 


Given that g(x, 0) = 0 and Og(x, @)/ do = ~Ag(x, ©) + Ag(x —1,0) for 1 <x< ©. 


If g(0,@) = 9:29 D+ using induction show that &(x, 9) = (А о)" 
, ч е 


Let X Бе Pois (А). Show that P(X 
decreses with increasing A. 


Net х1. 


= 1 > 15 a fit 
IX21)= Ме ~1) and check whether this probabil j 
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11. Let X be Pois (A). Find p = Р(Х = k)/P(X < x) for positive integer k. Also show that p satisfies the 


i i i ip (А-А 
differential equation : P = ) 
- Sr |n foe | 


12. Treat the Pois (A) as a function of the parameter А for fixed x. Show that fhas maximum for 


i 2, JI E À = x and f has two inflection points аіл = x + vx for x = 2, 3, ..., and one 
inflection point at A = 2 for x = 1. 


13. If X pois (A) show that P(X > т) « A'/r !, r=0, 1,2, ... Deduce : E(X) < е^. 
14. Let X and Y be two independent Pois (A) variates. Find the p.m.f of max (X, Y) and min (X, Y). 


[ Ans. f(2 2F(z-1) + f(- f@2- F—- Еб VL ЈО) = е^ X/z | 


15. Let Х|, X,, ... be a sequence of independent bin (1, p) variates with 0 <р < 1. Also, let Sy = X, 
+ X, +... Xy, where N ~ Pois (А). Show that Sy and N- Sy are independent. 
16. Let X and Y be independent r.v.s. with P(X =k) 2 p, P(Y= Мн q, 0 <k< and 2p,=1= 24), 


Let P(X=kIX+Y=1= (a, (1-89, OS cs t, 


à" -0 ak 
Then A, = a Vt, and p, = ы а = = г? where B = i = , and 0 > 0 is arbitrary. 
! -Q 


17. Let X ~ Pois (A) but À ~ expo (1 3 Show that P(X = п) =(1/2)"*!. 
18. Construct a Poisson counting process based on the definition of Poisson p.m.f. and establish 
its equivalence with §13-11. 


13-20. Poisson Approximation to the Binomial pmf 
If p > О and n — o in such a manner that the mean np = À (say) > 0, remains fixed, 
then the bin (n, p) density approaches the Pois (A) density. 


Proof. fix) = ("Ja "В. cuesta лык ЖАРД, E Э. ыа ый "(1 py 
1 1 2 kd X n-x 
= 16-2)6-2). (1-223) ор (1- p) net) 
Recall : lim finan =e”, (n— oo) (Euler’s Limit) .. (A) 


. Arn мүн V Pos 3^ ү =") 
ima-p"* = (1-8) ce bns 


Also Him (1-1)(1-2).. (1-21) (1—0) (1-0)...(1-0) =1 


no n 


Making substitutins into (1) we get 

lim f(x) = е^ /x!, x=0,1,2,...0. 
Note. We can also obtain a Poisson approximation to the binomial distribution for the 
Case when n is large and nq is small. Letting y = n — X. We have 


б n-X р y nay _ V 
lim (" дра" = lim(, п Ja-o 4 = tim (2) a- or ce n» 


n>% n 


Where 4 = nq is the paramter of the Poisson Distribution. 
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Example 1. Let Xi Х,, ..., X, be i.i.d bin (1, p) variates Let $, = Х.Ф uo X, and M (1) 
be the m.g.f. of S,. Find lim M,C) using np = A (const.) 


Solution. Here M(t : X,) = (q+ pe')', 50 M(t: S,,)= (M(t: X,)]" = (4 + pe y. 
[1 = p(e' - D] = 1+ (её! -DA/n] 


Thus, M Kt) 


. , (e! -1)À A Ce! - 1) 4 yu . : 
lim M,() ау рн р е [By Euler's limit] 
n>o л» o0 n 


It follows that 5, — Pois (A) as n > oo, with np = А (fixed). 
Example 2. Let Х|, X», ..., X, be independent Indicator (Bernoulli) variables : 
P(X, = 1) = pj, P(X; =0) =4; and $, = X, + X, +...+ X,. Show that if max p, > 0 and 
(p, + Po +... + p,) — А, (0 <А < o) as n — oo then 5, ә Pois (A). 
i i м Айу 3 d м L) , NN 
Solution. G(t: X) = E(r")-q;t ttp, lx (t- Dp; = 1t p; (r1 =) 
G,(t) = Са: S,) - G(t: X; +...+X,) 2 G(t: X,).G(t: X;)...G(t : X, y=(1+t'p,)...+t’p,) ...(1) 


(Y у) | 
J аа)" 
As n — ©, ÈP; > А, Ep; — 0 (as max p; > = 2...) and ANS 
in CON 9 Gare”. 
This is p.g.f. of Pois (A). Hence by Continuity Theorem, S, — Pois (A). 
Remark. |f р; = р, у, then (1) provides : 
С) = (1+1 p) = [L+ (А / п)]". 


Thus С, (0) 5 e 7? : Poisson approximation to the Binomial distribution vide Example 1. 


бп G, (t) = > бп (1 erp) У, m 


Occurrence of Poisson Distribution | 

The Poisson distribution finds applications in a wide variety of situations in which 
some kind of event occurs repeatedly, but haphazardly. 

Typically situtations are those in which the events of the following nature occur : 
(a) Number of telephone calls arriving at an exchange in some unit of time. 

(b) The number of defective items in a given lot. 

(c) The emission of radio-active (alpha) particles. 

(d) Completion of a repair-job by repairmen. 

(e) Number of defects in a tape or in a sheet of manufactured material. 

(f) The number of printing (typing errors. 

(g) Bacterial colony on a Petri plate. 

Treated as an example of a rare event (Art 13-20), such situations as under are encountered : 
|. The number of rail road (or air-crashes) accidents in some unit of time. 

2. The number of insurance claims in some unit of time. - 


$13-21. Worked- out N umericals 4 2 1 


3. The number of deaths caused by the kick of a horse. 
4. The number of deaths caused by suicide or by diseases such as snake-bite, heart- 
attack, cancer, etc. In some unit of time, etc. 


13-21. Worked-out Numericals 

Example 1. А epe hospital usually admits 50 patients per day. On the average 3 
patients in 100 require special facilities found in special rooms. On the morning of 
a certain day, it is found that there are three such rooms available. Assuming that 50 
m will be admitted, find the probability that more than three patients will require 
such special rooms. 

Solution. Let X be the r.v. denoting the number of patients that will require the special 
rooms. Then X is bin (n, p), where n = 50, p = 0.03. We need find P(X > 3). Now 


ВОХ) i=) 1-P(X €3)21— y 0) 00.03)" (0.97) *. 


х= 0 
We сап approximate this sum by Poisson distribution. Неге т = np = 50 x 0.03 = [9 : 
hence 


3 e"? 5i 
P(X > 3) = 1- P(X <3)=1- У, mu ui ru 


x=0 
Example 2. Assume that the number of cars passing an intersection obeys a Poisson 
distribution. If the probability of no cars in 1 minute is 0.20, what is the probability of 
more than one car in 2 minutes ? 
Solution. P(X = 0) = e^ = 0.20 ; hence A = п 0.2 = (п, 5 = 1.60944. 
Now taking 1 minute as a unit of time, we have A = 1.60944. Hence the average 
number of arrivals per 2-minute interval is 2m. Now if X ~ Pois (2A), then 


P(X»1) = 1- Р(Х <1)=1-[P(X = 0) + Р(Х = ]1 - [e ^ +e (2А)] 
= ]-e7 (142X)21- (02) [14 32188] = 1 — 0.168752 = 0.8312448. 


Problems with Solutions Provided at the End of the Text 


1*. If the probability that a individual suffers a bad reaction from injection of a 
given serum is 0.001, find the probability that out of 2000 individuals, (1) exactly 3, 
(ii) more than 2, individuals will suffer from a bad reaction. 

2*. It is known tha the probability that an item, produced by a certain machine will 
be defective is 0.01. By applying Poisson's approximations, show that the 
probability that the random sample of 100 items selected at random from the 
total output will contain no more than one defective item is 2/e. | 

3*. A device contains 2000 equally reliable elements with prob. of failure for each 

of them equal to 0.0005. What is the probability that the device will fail to operate 

if failure occurs when at least one element fails to operate ? 

The King’s minister boxes his coins n to a box. Each box contains k false coins. 

The King doubts the minister and randomly draws a coin from each of n boxes 

and gets them tested. Find the chance that 


4*, 
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ns contains exactly r false coins. 


cted. | 
in 500 misprints. Find the prob. that the, 


(i) King’s sample of n coi 
(ii) Minister's peculations go undete 

5*. The proofs of a 500-page book conta 
are at least four misprints per page. RPE рол die 

6*. An insurance company finds that 0.005 percent of the pop m. * Of road 
crossing each year. What is the prob. that the pompany MP. pay ү E тоге 
than 3 of 10,000 insured risks, against such accidents in a given year 

7*. Obtain a formula for the number of Poisson trials required for a specified certainty 
of at least one success. 

If intact specimens occur on the average of 
removed, how many cubic feet of earth is to b 
of obtaining an intact specimen ? 

8*. The number of criminals being hanged in a week is a Poisson variate with mean }, 
However, 2 itself is a variate which takes on one of the values 1, 2, 3, 4 with respective 
probablities 1/3, 1/3, 1/4, 1/12. What is the probability that no criminal is hanged. 

9*. The number of cars passing an intersection during any time interval of length: 
minutes between 6 P.M. and 7 P.M. is Pois (f) distribution. Let T be time elapsed 
after 6 P.M. before the first car crosses the intersection. Find P(T « 1). 


2 per 10,000 cubic feet of earth 
e removed in order to be 95% sure 


13-30. Two-Parameter Poisson Variate 
In many applications of Poisson variate, it is convenient to replace À by ct and obtain 


Кх; с, 0 = е Ө ЛЛ c>0, t>0, x=0,1,2,...; fG5c,r) 20, otherwise (А) 
We call f(x ; c, t) the Poisson distribution with parameters c and т. Here ¢ is usually an 
interval of time (or space) over which the number of occurences of some event is 
observed, c is the average number of such occurences рег unit time (space). fix; 6^ 
gives the prob.of exactly x occuences in an arbitrary interval of time of length /. 
Example : On the average, a submarine on patrol sights 6 enemy ships per hour. 
Assuming the number of ships sighted in a given length of time is Poisson, find the 
prob. of sighting 
(a) 6 ships in the next half hour, (b) 4 ships in the next two hours. 

(c) at least one-ship in the next 15 min., (d) at least two ships in the next 20 min 
Solution. (a)Here c = 6, t = 1/2, ct 2A 23 


e?(36  00498x9x9x9 
P(X = 6) NUDO Lu m 0415042. 
(b) Here c = 6,7 = 2, А = ct = 12 


e Moy 
PX = 4) = EFL = (00025) 144,6 = 0.0054. 
(c) Here c = 6,1 = 1/4, = et 3/2: 1.5 


PX z 1) = 1- РО 0 е р 02551-07760. 


_Exercise 13(b) | i pa 423 


ees S, mu 


P(X 22) = 1- [P(X = 0) + P(X = 1)] = 1 372 = 1- 3 x 0.1353 = 1 — 0.4059 = 0.5941. 


10. 


1. 


12, 


Exercise 13(b) 


Use Poisson distribution in order to approximate the binomial distribution : 

(a) n=100,p=0.02,x=5 (Ы) nz20,p-20.05,x-5 

Six coins are tossed 6400 times, Using the Poisson distribution, show that the approximate 
value of getting 6 heads x times is e 9 (100)'/x !. 

A manufacturer of cotter pins knows that 5% of his product is defective. If he sells cotter pins 
in boxes of 100 and gurantees that not more than 10 pins will be defective, show that the 
approximate probability that a box will fail to meet the guranteed quality is 0.013695. 

A distributor of bean seeds determines from extensive tests that 596 of large batch of seeds 
will not germinate. He sells the seeds in packets of 200 and gurantees 90% germination. 
Determine the probability that a particular packet will voilate the guarantee. 

Patients arrive randomly and independently at a doctor's Surgery from 8 A.M. at an average 
rate of one in five minutes. the waiting room holds 12 persons. Show that the probability that 
the room will be full wen the doctor arrives at 9 A.M. is 0.5384. (Estimate the probability to 
an accuracy of 5 percent). 

A car hire firm has two cars, which it hires out day by day. The number of demands for a car 
on each day is Poisson distributed with mean 1.5. Calculate the proportion of days on which 
(a) neither car is used. (b) some demand is refused.(e ^ = 0.2231) [Ans. 0.2331 ; 0.19126] 
A man is standing some distance from blasting operations in a quarry. Ten small pieces of 
debris fall randomly within space of 12 sq. yd. If the plan area of a man is 2 sq. ft, show that 
the probability that if the were standing within 12 sq. yd, he would not have been hit by any 
of the pieces of debris is e 

A telephone switchboard handles 600 calls, on an average, during a rush hour. The board can 
make a maximum of 20 connections per minute. Show that the probability that the board will 


be over-taxed during any given minute is ЖӨ P51, 21s X eus; 

The average number of telephone calls reaching the switch board of Daffodil-Company is 30 
calls per hour. Find the probability that (a) No call arrives in a 3-minute period (b) More than 
five calls arrive in a 5 minute period. 

The number of telephone calls that an operator receives from 9.00 to 9.05 hours in a day 
follows Poisson distribution with mean 3. Show that the probability that 

(i) The operator will receive no calls in that time interval tommorrow is We. 

(ii) In the next three days the operator will receive a total of 1 call in that time interval is 9e”. 

A radioactive source is observed during 4 time intervals of a 6 seconds each. If the number of 
particles emitted during each time interval follows a Poisson probability law with a rate of 
0.5 particles per second, show that the probability that (a) in each of the four time intervals 
3 or more particles will be emitted, is 0.109. 

(b) in atleast one of the four time intervals 3 or more particles will be emitted, is 0.968. 

A large number of observations on a given solution which contained bacteria were made 


taking samples 1 ml each. nothing down the number of bacteria present in each sample. 
Assuming Poisson distribution and given that 10% samples contained no bacteria, show that 


the average number of bacteria per ml is (п, 10. 


nctions (or Transfer Methods) — 

ed by examining a specimen of the blood under 4 
xed volume contains, on the average, 20 red, ell. 
at the probability that a Specimen 
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13. Red blood cell deficiency may jedes d 
micro-scope. Suppose that a einn show th 

4 . Using Poisson distri Ж і. 

for normal person. Using ed cell is Le EGO Ux! 0<х<14 


d to taxi drivers is 0.001. Out of à tota] 


; r 
from a normal person will contain less than 15 


14. (a) The chance of a traffic accident in a day, attribute 

of 1000 days, on how many days we shall have | 
(ii) more than 10 accidents. | 
How many tubes would you stock so tha; 
demand for a 30-day month ? (Sales ође, 
d T, with X as the mean rate of occurence 


i [А п. (1) 368 day 
(i) no accident. i 
(b) You sell an average of 2 T-V tubes per day. 

, With probability that at least 0.95, you will meet 
Poisson law). Generalize the sales for time-perlo 
per unit time. 

15. In a double sampling scheme, a sample of 50 items is selected f E 
accepted if the sample has no defectives. If the sample hsa 3 or 4 defectives, the batch is 
rejected. If the sample has one or two defectives, a second sample of 100 items is taken and 
the total number of defectives in the two samples is noted. If this total of defectives is five or more, 
the batch is rejected, otherwise the batch is accepted. Show that the probability of accepting a 
batch with 1% defective items is 0.974. What is the average of inspection per batch ? 


rom a batch, and the batch iş 


13-40. Recurrence formula for Poisson Density 
When computing the Poisson density numerically, one can often use a process of 
iteration based on the equations 


Дх +1) = [АА 4D]: f(x); [/(0) = e^]. (А) 
To prove it, we notice that 
fe*D etie a 
f(x) E Ix! х+1` 


This yields (А). f(0) = € ^, is first evaluated and then (A) is applied recursively to 
compute the remaining f(x), one after the other. 


Example 1. A Poisson distribution has a mean of 0.63. Find respective probabilities 
of 0, 1, 2, and 3 occurence of the event in question. 
Solution. КО) = е^ =e =0 5326 [by def.] 
Putting x = 0, 1, 2, 3 sucessively in the Recurrence formula we get 
Д1) = X. f(0) = (0.630) (0:5326) = 0.3355; fQ= i А f(1) = (031 5) (0.3355) = 0.1055 
K3) = 1X f(2) = (0.210) (0.1055) = 0.0222. 
Example 2. In a certain factory turning razor blade 
any blade to be defective. The blades are sy 
distribution to calculate the approximate num 


one defective, two defective, three defective an 
of 20,000 packets. 


Solution. Here n = 10, p = 1/500 so that А = 55 — of 1 
defective packets in N = 20,000 packets the; пр = 0.02. If f(x) is the frequency 


s, there is a small chance 1/500 for 
Pplied in a packet of 10. Use Poiss” 
ber of packets containing no defect” 
d four defective blades, in a consign™” 
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ро) = Ne А / x! = 20,000 x 0.9802 x (0.02) / x [ ng Fi °| 
=з Ж 


ЖО) = 19604 (Number of packets with no defective blades). 
So Д1) = (0.02) x 19604 = 392.08 = 392 ; f(2) = 0.01 x 392.08 = 3.9208 = 3 
АЗ) = (0.02 x 3.9208)/3 = 0.026137. Obviously f(4) is nearly zero. 


Problems with Solutions Provided at the End of the Text 


1*. Find mean and variance of Pois (А) by differentiating the exponential series. 

2*. Critize the following statement : 

“The mean of a Poisson distribution is 5, while S.D. is 4”. 

3*. If X is Poisson distributed with parameter 100, use Chebyshev inequality to 
determine a lower bound for P(75 « X < 125}. 


13-41. Mode of the Poisson Distribution 
We have to find the value of the random variable X ~ Pois (A) for which the prob. 
is maximum. Thus if x is the modal value its definition provides : (i) f(x) = f(x + 1) 


(ii) fo) 2 Дх 1) 
The Poisson Recurrence formula is : f(x + 1) = [A/(x + 1)] f(x). Using this we see that 
ENSIS x) x*1sA Le, sil zf- => XA. 

Combining the last two inequations we obtain 

À-1sxsA С) 
Case 1. Let A be a positive integer. Since the integer x lies between two consective 
integers A — 1 and A, equation (1) is possible iff x = m and x = m — 1. And thus there are 
two modes for the distribution in this case. 
Case 2. Let à be a fraction (rational number). Then the integer x lies between two 
fractions differing by 1. Hence x must be the integeral part of А written [A]. 
Example 1. A Poisson distribution has a double mode at x = 1 and x = 2. What is the 
probability that X will have one or the other of these two values. 
Solution. Poisson's mode is given by А — 1 € x € А. Hence when x = 1, A — 1 = x gives 
N= 2, and x = 2, à = х gives À = 2. Now Р(Х = K) =e" Nk}. 


-2 -2 242 
еу TUREN Т. à 
Tino P{X =2}= jp 


P{X=1} = 


Hence — P{(X=1) B (X22) = P{X= 1) + P(X = 2) = Ale". 
Exercise. At a certain telephone exchange the average number of cal 
hour in the morning is 120 and the rate can be regarded as constant. 
Probability of exactly 3 calls in a period of 5 minutes, and of more than 
Same period. What is the most likey number of calls ? 


Is passed per 
Calculate the 
3 calls in the 


Example 2. Monotonicity. For Pois (A) let KK) = ^m'/kYX O<k<o. Show tha, 
Kk- 1) 5,2, <f{k) Ok>, = em, 
f&-D ем): К. 
fü). 1m qom m 
fk - If) >, =; <1 e (Ит) <,2<1, ВЛЕ Do 7. «A9 > k>, = 
Note. ҚК — 1) = fk) holds if А is an integer. 


Solution. 


13.42. Mean (absolute) Deviation (M.a.D) 
If X is Poisson (А), then by definition 


M = EIX-AI- X, fo)ix- Alo X f(x) (х А) + ESO) A-1) 
x=0 х>А х < 
0 -E(X-3)- X уо) У G-3* УЛО) (А) 
х= 0) X x< 
Adding these relations, using 0 = [A + 1] : greatest integer function 


1 RA AR p * е^ л 
;M = Efo96G-9-e с Em [ro | 


x! 


> È (T,-T,)-e^T,. (Telescopic Series) т = "md 


t= 


M = 2е7^.А (0 – 1)!, where 0 - [A +1] 
Note. lim ы" lim 7, =0, since this series is convergent. 


ox! no 


Example 1. Show that if X is Pois (1) its mean deviation about mean is (2c y fe). 


Solution. The result is immediate from §13-42, putting А = 1. However, we may proceed 
independently : 


M. x E P TIE Sex) ts), 
0 = dus er ot d en 


Adding these equations and using A = 1, we get 


;M - D (x- 1) f(x) = p f(x) - L0 [Р f(x) -70 >| Y f(x) - 700) -fm 


x20 


[= f0-[-f(0-f01-f(0)-e* у) елу, А = 1] 
= (2/е)= (26; Ге) as o, =A=1 
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Aliter. M EIX -1ls У f(x)ix-1is 00) + Y f(x) (x- 1) f(0) 4 Y x f(x) ? Fx 


va) 
Y X 


У f(x) – f(0) | = 2f(0)+A-1=2/e. (А = 1] 


Iv 0 


f(0) 4 


> wT (x) ro] 
0 


\ 


À 


Example 2. 1f X is Pois (A), show that E (IX —11) 24 42e - 1. 
Solution. Here fx) = "ay ie ea two LA 


ЕХ) = 2, f(x).lx-11= f(0) y f(x).(x-1) = f(0) + » x f(x) - Y f(x) 


х= 0 


FO) | YxfQ) - 500] -| Y f(x) — f(0) — sol- 2F(0) Ў xf- E(x) 
x=0 x=0 


с=0 x=0 
Бенд 1. [f(0)=e7*] 


13-50. Moments of Poisson Distribution 
Direct derivation of moments. The following chain is very convenient to obtain 
Poisson’s moments. 

Simple factorial moments — Simple moments — Central moments. 


Simple factorial moments : 


о -A4x о x-r 
Ms SEX) = X £5 Mae Y SUN ye = 1 


Бч е бн ТРУША 

Thus, и, = А. In particular, ру = р = А, но = А2, etc. 
Simple moments through simple factorial moments : 

н, = E(X?)=E{X? + X}=E(X) + E(X) = т? + т. 

pj = EQO) 2 E(XO «3x? + X 223 + 332 + А 

uj, = E(X* -E(X? «6x? «7x? + X) - А + 633 + 7X + А. 
Central moments through simple moments : 

Hy = щ- (ш) = +A) -X =A 

By зш «Xn =O? 3324 A) 303 LAA +20 =) 


By = wh = 4р. н; + 6n (uy —3ц° 
(at +603 + 7А2 + А2) – 4А. (А + 30° + л) + 64202 + А) - ЗА = 332 + А 


Ramanvosky Moments Recurrence Formula 
we = Аер, 1 +А (dp, Г). 
eo 4-À4X 
e X 


Proof. By definition, p, = E(X -ÀY = ? AO Ay = у ар. (х=). 
х=0 х=0 d 
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W 
We assume that the above series is uniformly convergent. No 


jot ЖУ Het n) oM 


"5 EN Je tet s етук AY е) х XY 1] 

x20 X: 

oo - жод T (х-л) 
рајон en] Ro 7n 
= E (X -AY*! 2 (X 2) ] 2 X EC 22 IDEEN =A uL. -n 


Thus, by transfer we obtain 
we, = A[rp, 4, dp, / dA] 
Note. Putting r = 1, 2, 3 in succession, using pọ = 1, H; = 0, D = 4/4, obtain 
Hy = Ang - ADp, =A, p,=2Ap,+ADp, = АР(А) = А, Hy = ЗА + ADH, = B +], 
M.G.E, РС.Е, Moments and Cumulants 
My. e a ree [$ 8-16(3) $ 8-51(2)] 
We can find mean or Poisson distribution at once. Thus 
| pj = Mo = [дее 79] =a 
To find central m.f.g. we have 
Mt:X-3)2 e&e* M(r:X)s eV. eM 7 e^ (et – 1-р). 
We now attend to cumulants : 
K(t) = In M(t) = In [e> ?]2 A (e! -D 2 Мг + (0720 € (0739  (* 144 (0/59 +..] 
Since k, = coefficient of (t/r) in K(t), we immediately obtain 
k, =A, = А, УЛУК, = X. 


Thus all the cumultants of Pois (А) equal the parameter X (mean) of the distribution. 
Since k, = А V r, we need no recurrence formula for К. 


Obviously : р =k, =A, Ш =k, =A, p, =k, =A, р, = k, 321 ҮЗ. 
a д л Кашы. o M Na E 
ХМ җы ao^ 35 quay 2 a 


zt Be id 
= SBi =", vsh-3-X'; u poy y =1. 
Example : If My(t) = PE а! find P(X > 2). 


o r 


і 
Solution. My(t) = | У, у ] = exp (e' — 1). 
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This is the m.g.f. of Pois (1) ; hence the p.m.f. of X is 
ЛО) = Р(Х= х) = ех x=0, 1,2 


P(X > 2) = 1- P(X < 2) =1- [f(0) + f() + f2]21- e [1 +14 (1/2)] = 1- (5/26). 
First Four Central Factorial Moments 


For Pois (A), Factorial moments are ц’ =A" [$ 8-31(2)]. Also using relations between 


Hr) and p, we obtain 
Ho = В =А; Bg = – 28, =А –- 3А = – 22. 
Шау = р. – би, + Пи, = QJ + А) – 6А + 11А = 3А2 + 6А = 3А. (А + 2). 


13-60. Additive Property. Subtractive Property 

1. If X, and X, are two independently distributed Poisson variates with paramters A, 
and А, егу, then X, + X, is also a Poisson variate with parameter A, + А... 
IProof. $ 8-54(2)] 

Comments. The result is not true if X, and X, are dependent.For instance, take X, = Х|, 
then X = X, + X, = 2X, takes only even values, hence it cannot have the Poisson distribution. 
2. If X, ~ Pois (А) ; X, and X, are independent, then X, — X, is not a Poisson variate. 
Proof. Since X, and X, are independent variates, we have 


M(t м X, - X.) E M(t: X,).M(-t:X,) =еч gt -0 = Мм Ае = 1) 


Since the right side cannot be expressed as е^ ~", we infer that Z = X, — X, is not a 


Poisson variate. The proof also follows by trivial considerations : X, 2 0, X, = 0, but 
"Nx Z« oo. 
As Z = X, — X, can assume negative values, it cannot be a Poisson variate. 
Aliter. Mean (X, Х,) + Var(X, - X,) — X, – X, is not Poissonian. [А — А А + А] 
Example : Let X ~ Pois (А) and Y ~ Pois (и). If A < р, prove that 

P(X < к) > P(Y <k) [k : any integer]. 
Solution. Consider an auxiliary г.у. Z ~ Pois (p — A) which is independent of X. By 
reproductive property, (X + Z) ~ Pois (и) so that X + Z has the same distribution as Y. 
Consequently 


k 
PUY <k) = P(X+Z<k)= X P(Z=r)P(X<k-r)< Р(Х <k) ЎР =) 


r=0 r=0 


= P(X <k).P(Z<k)< Р(Х < k), [since P(Z < К) « I]. 
Thus p (Y € k) < P(X < k). This result says that the smaller the parameter А, the more the 
IS (A) is shifted to the left. 
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13-61. Binomial approximation of Poisson’s Distribution 
Suppose X is Pois (A) and express X as a sum of л indep. Poisson variate X, ; where 
each X, is Pois (A/n). Thus X = X,+X,+..+ A, 
Now choose n in such a way "T Р(Х, > T 18 Байы. which implies that A/n must 
be very small. Consequently the variate X, is necessarily a Bernouli variate (zero-one 
variate), and so 
P(X,20) = е" =1-(A/n); P{X, = 1) = 1- Р(Х, 20) 2 A/n. 
With this interpretation, X can be viewed as bin n, p, where р = А/л and so 
k 

ok s paco (tp a 
This approximation holds good when p = A/n is small, n large and A = np ‘moderate’ 
Remark. This proof builds binomial distribution from Poisson law. 


13-62. Worked-out Problems 


Example 1. If X is Poisson with parameter A, show that (X — A)/ JA is a standard 
variate. Find m.g.f. for this variate and show that it tends to e" as À — o. 
Solution. See $11-31. Example 2*. 


Important Note. For a N(0, 1), M(t: X) = em Hence what we have proved in essence 
is that : "As л — oo, p remains moderate, np = А — œ, then Poisson distribution tends 
to normal distribution". Another proof of Normal approximation to the Poisson 
Distribution, using the density function and not m.g.f., is given in the chapter 17. 
Example 2. Let X and Y be independent Poisson variates. Show that the conditional 
distribution of X, given X + Y = п, is binomial. 


Solution. Let X ~ Pois (A,) and Y ~ Pois (А,). Since X and Y are independent, by additive 
property, Z = X + Y is Pois (A, + A,). Now 


P(X2rX*Y-n] P(X-r.Y 2n-r| _ Р(Х = ғ) Р(Ү =n-r) 
P(X +Y = п) РХ +Y =n) P(X +Y =n) 


e^ (Ay sy Эш. +13)" n! А, r M n-r 
r! (л-г)! п! т иг r)! К+. m А, +A, 


À 
n ron-r ES 1 „її. 
|") 4 (uae т” 1-р 


Р{Х= кі Х+ Ү= п) = 


Hence the conditional distribution of X, given Х + У = п is bin [n, A, / (A, + А). 


Example 3. If X and Y are independent Poisson variates with means A, and A,, find 
the probability of (i) X + Y = k (ii) X = Y. 


b 
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Solution. Since X and Y are independent = — 


G(t : X + Y) -XG(t: X) G(t:Y) = ei- 0 phat 1) = eh tag t=) 
This shows that Z = X + Y ~ Pois (A, + A). hence 
Dp mage e Ox C rep nia 
(ii) Independence of X and Y is given by 


g eee 


G(t : X - Y) = G(r: X)G(t" y) = eh - Dot - n Lg 0 9) + yt tht IDA! 
P(X — Y 2 0) = Coeff. of t° in G(t : X — Y) = const. term in (A) 


METTI SA GEOP ERES ЕК 0 
=e х const. term in| b» Sale 2 


k=0 j=0 " 


err) YO, X) ОЕ), — k-0,12,... [Take j = К] 


SPINE LY =) = VRK) 
k=0 k=0 


Aliter. Px = Y) 


eee 2 AD (el) es А 4 ^7 (Ж, ОК < о, 


Example 4. Let X ~ Pois (А) and Y ~ Pois (A,) be independent and let Z = X — Y. Prove 
that | 


P{Z=r} =coefficient of t’ in exp{-A, — A5 € Ait + Ast ]. 
Deduce the p.m.f. of Z when A, = А. 
Solution. Since X and Y are indep. the p.g.f. yields 
G(t : X - Y) = Gt: X).G(t:-Y) =G(t: X) Gt :Y) 


-м@-1). e -) gids PA Mt 


G(t:Z) =e 
So, p, = Р{2 = r} = coeff. of t” in G(r: 2) (Def. of p.g.f.] 
Р, = Coeff. of t” in exp {~À – А * t +A ^k 
Deduction. Using exponential series, we can rewrite (1) as 


Мый asus A xs 
p, = grit) coeff. of t" 16 oun) pec 


ј=0 k=0 


N TIE i 2 үз 
g o» (4) 2) [usin k=r] 
2 p КТО +7)! [ gJ 
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When A, =A, = à (say), then 


whe 


o0 jer 22 à 
ante < |= е | (2А 
ды (2 cien] А : (2) 


re /, (2A) is Bessel's modified function of order r and argument 2). 


Note. We can obtain (2) directly as under 


1, 


. The m.g.f. of a variate X is е 


GOA GG: X) GG: ЮС X) GC Y) e 84-9 eh -9 2 omn 


p, = Р(2 = ғ) = СоеЁ. of t inG(t: 2) 2 e ?^ Coeff. of t’ in 


© j оо -l4k oo 2k+r 
(E (А) e Q2) Js jan y LOO) LL 


Fo RE k=0 kzo К! (К+)! 


Problems with Solutions Provided at the End of the Text 


. Is the Poisson distribution skewed to the right or left ? Compute Pearson’s measure 


of skewness for this distribution. 


- Deduce the first four moments about the mean of the Poisson distribution 


from those of the Binomial distribution. 


Let Х|, X,, ..., X, be i.i.d Pois (A) variates. Find the distribution of the statistic X. 


. X, and X, аге two independent, variates X, is Pois (A) and X, + X, is Pois (А + p). 


Find the distribution of X. 


. If X ~ Pois (№ and г.у. N possesses m.g.f. M,(n, find Mr). 
. Let X 2 X, +X, +... + Xy, where X, Q = 1, 2, ...) are independent and N is Pois 


(Ө). Find M,(r). Simplify the result if X; are i.i.d. 


. Suppose that M(t : X) = е0, x=0,1,2,.... Find the p.m.f. of X. 


4e'-1) Show that 


P(u-20«X«p-*20] = 0.931. 


. Show how the m.g.f. of binomial distribution tends to that of the Poisson 


distribution. 

. The number of deaths per day in a city due to road accidents and due to othe! 
causes follow Poisson distribution with parameters 2 and 6 respectively. Find 
the probability that the total number of deaths іп a day is 10 or fewer. What ? 
the maximum probable number of deaths in a day. | 
If X, 1 <i < К are indep. Poisson variates, show that the conditional distributi?" 
of X,, given X, + ... + X, is binomial. 


O o NN E E " Gaat А : а mop -— 


1. 
2. 


еюм Ф 


10. 


1. 


12, 


13, 
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Exercise 13(c) 
If X is Pois (A), show that E(X?) = А EX + 1, 
(a) Identify the distribution with M(t) = exp 3(е' — 1). Find EAP) alec 


(b) Identify the variates X and Y when M(t) = (1/ 27) (1+ 2e m D 


МИ?) = (1/32) (1+ e')5 , e20- 


. (a)If X is a Poisson variate and f(0) = f(1) show that E(X) = 1. 


(b) If X is a Poisson variate and f(0) = 1/2, show that Var (X) = п, 2. 
(c) Let X ~ Pois (A). Show that E(e ^5) = exp [-A(1 — е7“) and find E(Xe ^5. Hence show that, if 


X is the mean of n indep. variate Хү, ..., X, each Pois (A) distributed then exp (—X) as an 


estimate of exp (—À) is biased, although X isan unbiased estimate of А. 


. If for a Poisson variate X, f(1) = 2f(2), show that f(0) = е”! and б. =]. 
. Let X bea Poisson variate such that E(X?) = 6. Show that EO S2. 


If X ~ Pois (A) and Y = X^, show that Corr (X, Y) (2. 1)/ [1+ 6X + 422). 
Let X ~ Pois (А). Find the m.g.f. of Y= 2X — 1 and deduce that Var (У) = 4А. 


. ІХ is Pois (6), show that P(0 < X < 9) > 1/3. 
. The number of aeroplanes arriving at an airport in a 30 minute-interval obeys the Pois (25). 


Use Chebyshev's inequality to show that the least chance that the number of planes to arrive 
within a 30 minute interval will be between 15 and 35 is 0.75. 

Suppose that the number of motor cars arriving in a certain parking lot in any 15 minutes 
period obeys the Pois (80) law. Use Chebyshev's inequality to show that a lower bound for 
the probability that the number of motor cars arriving in a given 15 minute period will be 
between 60 and 100 is 0.80. 

A toll tax of Rs. 5/- is collected by the Government from the drivers of every car and bus that 
crosses a certain bridge. The number/s of cars and buses that cross the bridge in a day are 
random variables having Poisson distribution with mean 5 and 4 respectively. Show that the 
probability that no toll tax will be collected on a certain day is е”. 

Let X be a Poisson variate such that 9f(4) + 90 f(6) = f(2). Show that (i) Еу = 1, (ii) g,, the 
coefficient of skewness = 1. | 


(а) Let X and Y be indep. Poisson variates with с> = 407. Find P(X +Ү > 2). 


(b) Let X and Y be two indep. Poisson r.v.s with means | and 2 respectively. Show that 


(i) PX «Y 24)-p? (i) P{X +Y <4) = X(e?3' /x!),0< x <3. 
If X and Y are independent Poisson variates such that P(X = 1) = P(X = 2), (Y 2) = P(Y = 3). 
Find P(X = 4). Show that Var (X - 2Y) = 14. 
IfX and Y are independent Poisson variates with mean | and 3 respectively, find the m.g.f. of 
2= 3X4 Y, and show Var (Z) = 12. 
Prove that the function that generates the central moments for Pois (A) is M(t) = exp {Ме -t- 1)]. 


Show that this function satisfies the differential equation dM/dt = At M(t) + ^ам а. 
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17. If X is Pois (A) and p, the rth central moment, then 
r r ^n 
Mea) = À У, () H,- j = ДӨГЕ +(5) 2 н) "I 
j=l 


18. If X is Pois (A), and р’ = E(X)' show that 


ш. = Alpi + (dp) /dA)]. 


19. If X is Pois (А), show that 
(i) P(X € 4/2) < 4/0. + 4) < AI. ; (ii) Р(Х 2A) < (А+ 1) < 1А. 


20. Write X= u[1-- (X — p)/ p], where p= E(X) and o^ = Var (X). Show that E(/ X) ~ Ju [1— (0° / 8u?) 


and if X is Poisson distributed, then Var (yX) is approximately 1/4. 


21. LetX ~ Pois (A) and Y ~ Pois (p) be independent. Find the joint p.g.f. of X and Z = X + Y. Deduce 
that 


P(X=rlZ=n)= pr Pp 41-р) 0<х<л. 


13-70. Miscellaneous Worked-Out Problems 
Example 1. If X ~ Pois (А), find E (cos tX) and E (sin tX). 
Solution. By Euler’s Thm: (Хх = costX +isintX. Hence 


E (cos tX + i sin tX) = E (е!) [Use m.g.f. of Pois (A)] 


й а; HE 
ES е^ D — gAl(cosr 1) +isin л) 


= eò- [cos (A sin t) + i sin (A sin ї)] 
Equating real and imaginary parts. f 
E (cos tX) = e0"? cos(Asint), Е (sin tX) = g^«osr- b Касино: 
Example 2. If X and Ү are correlated variates each having Poisson distribution, show 
that X + Y cannot be Poisson-distributed. 
Solution. If X ~ Pois (A) and Y ~ Pois (и), then E(X) = à = Var (X), E(Y) = p = Var (Y) 
Since X and Y are correlated, so р = Corr (X, Y) +0 


E(X +Y) = Е(Х) + Е(У)= А+ р 


Var (X + Y) = Var (X) + Маг (Y) + 2 Cov (X, Y) = А+р+2,/Аи р, (р #0) 


Since E(X + У) + Var (X + У), it follows that X + Y is not Poisson-distributed. 


Note. Since X and Y are related, let Y = АХ (or Y = Ф(Х)]. Then Z= X +Y = (k+ 1) X; 
and Z may assume even fractional values; so that Z is not a Poisson rv. 
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Oe NMMEMNMEM к à 

Example 3. Let X ~ Pois (A,) and Y ~ Pois (A ») be independent variates Find 
E(XIQCUEY = n)}. 

Solution. By addition theorem, (X + Y) ~ Pois (A, + А). 


yn (Ay +А,) n 
P((X & Y) = n] = e A, +A)" (1) 


Further P{X =k, X+ Y=n} = Р(Х = к, У= п-к). 
= Р(Х =k). Р(Ү =n-k), [By Indep.] 


(11) 


йыз! echo и D A) Qu" 
k! ^ (n-k)! Vk 


n! 


Р{Х =k,(X + Y)=n} 
P(X * Y)-n) 


«йш. [ A .. - (2) MM 
ARAL +A) VA tay p Р 


where p = A, / (A, +А,). Thus the conditional probab. is bin (n, p) and its mean is np. So 
E[XI (X + Y 2 n)]] = пр= пл, / (А, +A,). 


Example 4. If X is bin (N, p) where N itself is Pois (A), find the characteristic function 
of X and hence deduce that X is Pois (Ap). 


P(X-kl(X*Y)2n)- 


Solution. — $(t: X) = Е(е) -E,Ee" (N) =Е(д + pe"). [Double-E Rule] 


= Е (0) = e ODs e r-i [p.g.f. of Pois (A)] 
This shows that X ~ Pois (Ap). 
Example 5. The joint density of variates X and Y is 
fo, y) = e?l[xty -3)], у=0,1,2,...;х=0,1,..., у 
Find the m g f. M(t,, t5), Corr (X, Y) and the marginal distributions. 
Solution. With the usual standard notation 


oo r -2 o0 у Y 
M(t,,t,) = Е енх+пї є : elt thy e - жей tà e" 
qr ei EU geal! yl 


ae? ў ete! Yee? Ў ice». 
y! 


e? .exp(l+e")e” 
y=0 y=0 y 


= exp [-2 ^ (14 e") e^] 
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From this we get immediately 
M(t,,0) = ехр(е" – 1) => X-Pois(1). M(0,55) =ехр2(е° -1) => Y ~ Pois (2), 
Thus the marginal distribution are Poisson variates with parameters 1 and 2 respectively 


And as such E(X) = m = 1;2=E(Y) су. 
Now K(t,t)) =n M(t, t,)=e°(1+e")-2 


O°K / dt, 0t, =e"*?, oyy =0°K(0,0)/ dt, Ot, =1;p(X,Y)=oy, / Oyo, 21/2 
Remark. M(t,, 0) . M(0, t,) = M(t, t) = X and Y are dependent. 


Problems with Solutions Provided at the End of the Text 


1*. Let Y, ~ bin (1, p) be a sequence of i.i.d. variates; and let X ~ Pois (A) be indep. of 
Ps. Show that S = Y, + Y, +... + Y, and D = X - S are independently distributed. 

2*. Let X - Pois (A), and Y = X, (К is real number). Find the mean and variance of Y. 
Deduce that 


1 7 
кае 01-а 12807 + E 

3*. The number X of blackflies on a board bean leaf is assumed to be a Pois (A). A 
plant inspector, however, records the number on a leaf only if there are blackflies 
present. What is the probability that he records x blackflies on one leaf ? What is 
the expected number of blackflies recorded per leaf ? What is the probability that 
the total number of blackflies from two recorded leaves is n ? 

4*. Let X be any non-negative о valued variate and a be any positive number. 
Show that P(X xa) «r^ Er), 0<t<1. ЕР) 
Verify the inequality : P(X < 4/2} < (2/e)™?, when X is Pois (A). 

5*. Let X and Y be i.i.d Pois (1) variates. If Z = min (X, Y), find P(Z = 1). 

6*. Find Corr (X, Y), when a bivariate distribution of (X, Y) has the p.g.f. 


G(s, t) = exp [a(s — 1) + b(t-1) + с(ѕ – 1) (c – 1)], (a, b, c all positive) 


ut E 


Miscellaneous Exercises 
1. Let X and Y be independent Poisson variates with Var (X + Y) = 9 and 


P(X231X4Y- 6) = 5/54. Show that E(X) = (9 + 34/3)/2. 
2. Let X by Pois (A). The conditional distribution of Y — 1, given X = x, is Poisson with E(Y - 1) 
= mx. Show that for y= 1,2, ... 


S Met Gm? jw 
пуу £| АТ Geb’ | and E(Y) = Le Am, Var (Y) = Am (1 + m). 


3. If X is Pois (A), show that E (1х IX >90) = (ем – 1)/ (е^ — 1) and hence find E (XIX > 0). and 
Var (X | X > 0). 


10. 


11. 


12, 


13. 


14. 


15, 
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A truncated Poisson distribution is given by mass function 


Ko s EN ET T к= 1,2, 
é T (r) i " 
Find the m.g.f. and E(X"^. Hence or otherwise find the mean and the variance of the 
distribution. 
Variates X;, i = 0, 1, 2, ... are independent and E(X)) = i. N is Pois (A) and is independent of the 


X, show that E(X, + X,+...+X,)=A(2+A)/2. 

For X - Pois (A), verify the following inequalities : 

(a) P(XS123)«(4/3). (Б) Р(Х> 2А) <(1/А). 

If X ~ Pois (А), show that E(1 + "Ni =(1- ree) and 

E[Q*3) Q&XJ =[1-(1 +) ел2, 

If X is any non-negative integer-valued variate and a is any positive number, show that 
PX2a)st* E(;0«t«n; P(X xa) «t? E(tX), -h «t«0O. 

Verify the inequality : P(X > 2А) < (e/Ay^, when X is Pois (A). 

(a) A catepillar 2a inches long starts to cross at rt angles a one-way cycle track H yards wide, 
at a speed of f ft/sec. If cycles are passing this particular spot at random intervals but at an 
average rate of A per second, what is the probability that the caterpillar reaches the other side 
safely ? Assume that the impress of a cycles tyre on the ground equals л inches and that the 
caterpillar may only be touched to be considered hurt. 

(b) At a busy street inter-section, it is estimated that a joy-walker will be hit by a car with 
probability 0.01. Assuming individual trips form independent trials, find the chance that the 
joywalker remains unhit if he crosses the street twice per day for 50 days. 

The number 7 of carriers of a disease in a certain district is Pois (A). The number of persons 
infected by different carriers are independent. Poisson variates, each with parameter 0. Find 
the p.g.f. for the total number of persons infected. Hence obtain the arthmetic mean and 
variance of this distribution. 

In a species of animals for which the sex-ratio at birth is 1 : 1, the probability of a litter being 
of size r is proportional to the Poisson probability of r with mean À. Prove that the prob. that 
all the animals in any one litter are of the same sex is 2/(1 674. 

A radio-active source emit on the average 2.5 particles per second. Show that the probability that 


3 or more particles will be emitted in an intervals of 4 seconds is Sa.) roy lxi. Зо. 


(a) The probability that a radio-active substance gives off n beta-particles in a unit of time 
is Poisson (A), n = 0, 1, 2, .... The probability that a given particle will strike a counter and be 
registered is p. Show that the probability of registering n beta-particles in a unit of time is 
also Poisson. Find also the mean number of particles registered in a unit time. 

(b) The number of female insects in a given region follows Pois (A) distribution. The number 
of eggs laid by each female insect follows Pois (A) distribution. Find the probability of the 
number of eggs in the region and its variance. 

It is known that if the average number of bacteria per litre of suspension ina reservoir is 1 00 
A, the number of bacteria present I c.c. specimen of liquid is a Poisson (A). Find the probability 
that, of five independent specimens, each of size 1 c.c. exactly 1 will contain no bacteria. 
Show that this probability reaches a maximum when A = In 5. | 

The suicide rate in state A is 5 suicides per one million persons per month. Find the chance 
that in a certain city of population 500,000 there will be at most 5 suicides in a month, what 
if during | year there were atleast 2 months in which more than 5 suicides occurred ? 
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16. 


17» 


18. 


19. 


In a certain experimental procedure, a given quantity of radio-active matter is available 
which emits K(f) particle in t seconds, where K(f) is Pois (10 t). it is required to choose n 
‘exposure time’ so that (a) on the average the number of particles emitted during the Exposure 
is not less than 10°, and more 10*. (b) The coefficient of variation of particles emitted during 
the exposure does no exceed 3.2 %. © 
In 1000 consecutive issues of the Utopian Seven Daily Chronicle, the deaths of centenarians 
were recorded, the number x having frequency f according to the table 
E 0 | 2 3 4 5 6 7 g 
JS 325 25J 119 50 17 2 | 0 
Show that the distribution is roughly Poissonion by calculating its mean and then the 
frequencies in the Poissonian distribution with the same mean and the same total frequency 
of 1000. Find also the variance of the given distribution. (e? = 0.2231) l 
Letters were received in an office on each of 100 days. Assuming the following data to form 
a random sample from a Poisson distribution, find the expected frequencies correct to the 
nearest unit taking e^ = 0.0183. 
No. of letters : 0 | 2 3 4 5 6 7 8 9 10 
Frequency: 1 EIS 2-— 21. 20 8 6 2 0 1 

[Ans. 2, 7, 15, 20, 16, 10, 6, 3, 1,0] 
From records of 10 Russian Army Corps kept over 20 years, the following data was obtained 
showing the number x of deaths caused by the kicks of a horse. Determine m, the average 
number of deaths per Army Corps per annum, and calculate the theoretical Poisson Frequencies 
and compare them with the observed frequencies of occurrences f 
o 0 1 2 3 4 Total 
T 4 «TH 65 22 3 1 200 

[Ans. e °°' = 0.5436] 


Love is photogenic, it needs darkness to develop. 


аан не ае н а НЕ НЕ Н ЕЕ ЕСЕ ЕСЕГЕ СЕНЫ БЫ НЫ АГАСЫ МЫ МЫ А МЫСЫ 


A lie told often becomes the truth. (Lenin) 


Geometric Distribution. 
Negative Binomial Distribution 


14-10. Geometric Distribution 
Definition. A random variable X possessing the following probability law 

P(X = х) = х) = др, x=0, 1,2, ..., f(x) = 0, otherwise x49 
is called a geometric variate. The distribution (1) is called the geometric distribution. 
We often express (1) by writing ‘X?’ as geom (p) or X ~ geom (р). 
Notes : 1. Geometric distribution is a particular (but most important) case of Neg-Bin 
distribution, when k = 1. Thus Neg-bin (1, p) = geom (p). [See § 14-60] 


© 


2. From (1), Ура -рУ qd Калк MES f(x) = 0, otherwise 
x=0 x=0 Ба р 


It follows that (1) is a legitimate probability mass function. 
3. As the various terms in (1) are the terms of a G.P.; the distribution has come to be 
known as 'geometric distribution'. 


Physical Conditions for the Occurrence of Geometric Distribution 

1. The result of each trial (experiment) can be classified into one of two disjoint 
categries, say, success (S) and failure (F). 

2. P (Success) = p, remains the same constant for each trial. 

3. The outcomes of all trials are independent of each other. 

4. The series of trials is performed a variable number of times until the first success 


is achieved. 
Note. Only the 4th condition differs from the conditions of Binomial distribution. 


14-20. Two Forms of Geometric Distribution : geom (p) and gem (p) 
Form 1. Let X denote the number of failures preceding the first success in a sequence 
of independent Bernoulli's trials. Then PIX =x} = 4р, x = 0, 1,.2, 3, 
Form 2. Let Y denote the number of trials required to obtain the first success in a 
Sequence of independent Bernoulli’s trials. Then P{Y = y} = Фф! руе 1.2.3, .... 
Relation, Y = X + 1. [E(Y) = 1 + E(X), Var (Y) = Var (X)] 
Since x + 1 trials are needed to have x failures and one succes 
Modelling. (1) We define the events as under : 

= (In the first x trials, there is no (i.e. zero) success}, B = 
P(B)= р; P(AB) = P(A) P(B) = q' p. 


s, we must have y = x + 1. 
{(x + 1)th trial is the first success} 


Then, P(A) = "С, q'p =q'. [Bin. p.m.f.] 


рп С —— — 


P(X = х) = q'p,x=9,1, 2, ee 
Modelling. (2) We define the events as under : 
A, = (In the first (y — 1) trials, there is zero (i.e. no success JM P 
Then P(A,) = °~'C, 77! p^ =?! [Binomial p.d.f.]; P8) = P P(A, В) = PCA) РВ) = 97 


Р{Ү=у} = g! p, у=123 
ару write Х ~ geom (р). 


Notation. For the support, E 
For the support x = 1, 2, 3,...., f(x) = Pik p, we write X ~ geom (p). it 1s often called 


Pascal geometric distribution. 


|; B, = {yth trial is the first Success]. 


Comments. Suppose trials are continued until the event (5) ee for the first time. 
The number X of trials performed before the event S occurs, is geom (p). 

If the number of trials counted (Y) includes the trial in which the event S occurs for 
the first time (written f.f.t.) then Y is gem (p). As such it is also notated Y - fft(p). 


14-21. Survival Functions and c.d.f. | 
Let X ~ geom (p) and Y ~ geom (p); then, survival function is P(Z > c). Now 


Sil, Albae Lo 2 eres 
P(X»a) = X. pg 2 pq (14q*4 +.) = m Gs 
acl 
o0 рд“ 
P(X x a)- У pq' = pq" 0 q* q' + Seq at 


F(a) = P(X Sa)=1-—P(XSa)=1=9"*"* (с. Е]. 
c rel b 2 pq’ 
P(Y>b) = У pd =pq (1+9+9 ix pt 
bel TM 
b-1 m 
= pq (qq! e.) FÀ nd 
+g 


P(Y >b) = » pq 
Fyb) = PY xb) -1- P(Y » b) -1- q*. 
14-22. Mean, Variance, Median and Modal Value 
For X ~ geom (p); Е) = хр; | EQ) = Zx? рд", O<x <0, zu 


Differentiating the geometric series 905 =4/(1- 4), 1<x< we obtain 


Zxq'' —-Mü-q) => Exq'-qlü-qY. @<х < о) (2) 
Substituting (2) into 1(a) gives E(X) = P.4!/(1 - 9 =q/ p. 
Differentiating the series (2) we obtain 
уха" = (1+q)/(1-q)’, ie. БОД =41+4)/01-49)?, 1<х<% PU) 
Substituting (3) in 10) gives E(X*)= pq (1-- q)/ (1— д)? - q(04- g)/ р?. 
Var (X) = Е(Х?) - E (xj- [(4 * 4)/ р?]— (4? / p) - а/ p?. 
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Median. Let m = Med (X). By definition : 

1 [т] A т+ 1 

2 = 2 Pq EE PU wer 
5 (т+ 1) па =- (12 > т= –1 – (n 2/0 д). 
Note. Med (Х < Mean (Х). 
Modal Value. Since f(x) = q p, x = 0, 1, 2, ... has the max. value only at x = 0, it 
follows that X = 0 is the mode of goem (p). 
рвет (p.Y-]1*X => E(Y) =1+ E(X) =1+(q/p)=(l/p). Var (Y) = Var (X) 

Med Y =1 + med X = - (п 2/0n д). 


Modal value is at X = 1, since f(x) = pq*^!, х =1,2,3,... attains maximum only at x = m 


Probability Recurrence Formula 
fo) 24'p, Rat 1) 2 qd pz 99р) =a fto. 
Thus fx *1) 24.f(x) 


14-23. Worked-out Problems 
Example 1. A die is cast until a 6 appears. What is the chance that it must be cast 
more than five times ? 
Solution. Here p = 1/6 (prob. of getting a six. If X is the number of tosses required for 
the first success ; then P(X = k) = q Ds kezi 142, s «sp that 

PX»r = Р(Х>г+1)= X PAEK У (ра )-4 

k=r+l r+) 

P(X > 5) = (5/6). 
Example 2. Let X ~ geom (р) and Y ~ geom (p) be independent. Show that conditional 
distribution of X | (X + Y) = n is uniform. 


Solution. Here Дх) = ра", x=0,1,2,3,... Now 


M(t: X4 Y) =[М‹: Хр = 101 - ge 
Z=(X + ү) ~ NB, p) > К) = (1+20)р 4 ie. Р(2= п) = (1 + л) ра" 


E P(X-rY-n-r) pd pd ' . 1 <г< 
AP(X-2rIX«Y2n]-7 "px«Y-n Bo yp m OST SN 


Thus, conditional distribution is uniform over 5 = (0, 1, .... л}. 
Note. f(z) can also be had through Multistage p-rule. | 
Example 3. Let X ~ geom (p) and Y - geom (p) be independent. Find p.m.f. of Z = min EE, Y). 
Solution. P(Z» 2) = PIX» zY»d- PX» 2.PY »2-(7 GY" [$14-21] 
P{Z=z} = Piz 2 9-Р 224 = PU >2— 1) - P{Z>z} 

= (44 – 84) - 1-94) (a4 

= ОР, 220,12... Q-qq, P-1-Q 
Thus, 2 ~ geom (Р). 


E 5 
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Problems with Solutions Provided at the End of the Text 


for a coin C, to show a head and T. * 
С, to produce a head, find P(T, >т, 
2. The outcomes of C, and c, 


1*. If T, is the waiting time (number of tosses) 
the corresponding waiting time for a coin 
where P{coin C; shows head} = р J = 1, 
independent. 

2*. A and B shoot independently until each ha 
probabilities 3/5, 5/7 of hitting the targets at eac 
probability that B will require more shots than A. | 

3*. A sample of 100 items is taken every hour from the output of a machine. If the 
sample contains 3 or more defective items, the machine 1s stopped for adjustment 
If the machine is producing 3% defective items, find the average interval of time 
between successive adjustments. 

4*. For the geometric p.m.f. f(x) = 2° = 1, 2, 3, ... show that Chebyshev's inequality 


gives P{ |X -21x 2) > 1 while the actual probability is 15/16. 


5*. X and Y are i.i.d. geom (p) variates and Z = max (X, Y}. Show that 
P(Z- m) = 2pg""  - pl q)q'" ^, (q-1-p, 15т<ә. 


are 


s hit his own target. They hay, 
h shot respectively. Find the 


14-30. Memoryless Property (or Markov Property) of Geometric Distribution 
If X is geom (p), then X lacks memory in the sense that 
P{X>s+tlX>s}=P{X>t}. 
Proof. For geom (p), survival function: P(X > a) = д, a = 0, 1, 2, ... . 
Therefore, P{X >s +1} 2 q'* !, Р{Х> 5} = 9. 
РХ ssf og 


Spic FEX on Sait CPUS bee ауан - 
q 


sgn 


Converse. Let s and t be integers. If the positive integral-valued variate X is such that 

P{X > s +t X> s} = PIX» t}, then X ~ geom (p). 
Proof. Let P(X > 1) = c. Set P(X = k)= p, and P(X > k) = g(k). 
Peat g(s) - g(s +1) = Pu / gs) = 1—[8(5 +1)/ g(s)] 21- PX » s 4 Ix» s] 21- (1) 
Thus p,,, = (1 — c) 8(5). [c= g(1)). We use this result recursively : GB) 
Pa = (1-0) (9) = (1-0) [fs - р.1=(1- 0) [gs —1)—(1— с) g(s - 1] - (1- с) cols -by C? 


02) 


= (1-с) cg – 2) = (1-с) с? g(s -3) =... - (1- c) c7! g(1) - (1- c) с". 
If we set 1 - c = р, then P(X = s) = рд! s =1, 2,3, ie у. geom (p). 
Remark. This property characterizes the geometric variate 


Note. The Survival function P{X > a} = q^, a= 0. | 


vu recognize 
geometric distribution. Thus if X = 1, 2, 3... is often useful to 


., then obviously 


Р(Х = = —1)— су 4 
( а) = P(x»a- 1) Р(Х >a)=q а -p»9" 5 а=1,2,... 


LL. $14-40. РС.Е, М.С.Е and Moments 443 
Example : If X ~ geom (p), show that ‘ ——— ЖЬ... : _. 


(i) eer +)! 420) = P(X > b), (ii) P(X =a+b\X2a)=P(X=b). [a,b = 0, 1,2,3, ...] 
Solution. (i) For geom (p), the survival function P(X > 4) = Tene: if LL Sn А 


P(X >a+b) a+b 
Meme bi aa) = atb BEP 
) Р(Х >а) F q" =q = Р(Х > b). 
(ii) P(X =a * b1X 2 a) = Сань) pq 
Р(Х > а) 4° 
These results refer to memoryless (agelessness) feature of geometric distribution. 


14-40. РС.Е, M.G.F. and Moments 
G(t : X) = p/(1-qt); G(t:Y)= pt/(1—qt), 1а11<1. [$ 8-51] 
M(t: X) 
Since Y 
G(r: Y) = G(t:X*- D) -tG(t: X) 31p/ (d - qt). 


= pq’ = P(X = b). 


p/(1—qe'); M(t:Y)= pe'/(1—qe'), \ge'l<1. 18 8-16] 
1 + X, we could get 


M(t: Y) = M(t:X +1)=e' M(t: X)= ре /(1- qe). 


Cumulants and Moments of Geom (p) 
K(t: X) = n M() = т[р/ (1 - ge )] = p - tn (1 - ge’). 


со d oo 
ELE = pt 2 
rz 2 r= 


We differentiate this result n times w.r.t t, and put г = 0, to get 


q РЦ 
r . 


[In series expansion] 


k= а іе а= LT (1) 
rzl iex 


We now differentiate 1(a), the uniformly convergent series, w.r.t. *q" and obtain 


di Fgh д Ў аа у (I 
dq rzl rzl 
k„,ı = q (dk,! dq), АЕРУ [Recurrence Formula] ...(2) 
From (1) putting n = 1, we get 
m r__4 —4 (Mean). 
һ " > 8 Pg Р 
obtained from (2). Let D = d/dq, then 


2 2 
| Í qu * 44 * 4) 
Eee y sup |- 2059. 1-902 )- 0+4) ес. 
pi pi Un SEA y (P p p 


2 
zqüeqp. Чы = +36, 


Various cumulants can now be 


Thus p= k=q/p, Hz; = 74! P. t=’ 


444 eamerie Distribution 
2 2 к, 1+4qt+q 695p 
Жа Жз: ncn! T 
! k q k; q 
It may be noted that the point, (B,, B2) lies on the St. line B, - В, = 5. 
Observe also : (k,/k,) = р < 1, k, =k, + ky. 


Since Mean = д/р Var = glp^, hence Var (X) > Mean (X). 


Comments. First Four Moments 


K(t) = in M(t) = [p/(1 — ge")] - n ([1— q(1 ++ ГЛ ..)/ p] 


-in [12 A(t +7? /2!- 2? /3!+...)], A= 4! p) 


1 2 
Mer 21) 3X er IZIP 30 Y ey HP 12+...) E m2 y. 
k, = N=q/ p, ky - A4 M =q/ pl k, 2 + 33 4 223 = 1+ X) (1+ 20) = q(1 + q)! p^, ег. 


Factorial m.g.f. and Factorial Moments 


-1 
Wt: X) = E(l-0*]2 Y ry bem ЕБР. Р -| d v 
di. ae d РУ, К I-q(+t) p-dt p y 


со t yi © L {Л 
Thus : Wt: A} = 2 (=) =}, (2 a [Neg. Binomial Expansion] 


Moy =г!(4/р), r=0,1,2.... 
We can recover simple moments from Eq. (2). 


14-50. k-Point Truncated Geometric Distribution 
Let X ~ geom (p) and remove probability masses at x = 0, 1, 2, ... k — 1. We need find 
the distribution of the rest of probability mass. 


Observe the Survival function : P(X 2 a) = 4“ [$ 14-11]. Now 
P{X = т 
Р{Х=х\Х>К}= MER ва арр рр. 


P(X2k) q 
If follows that even the truncated distribution is (shifted) geom (p) I (x = X). 
o0 © k 
Gin » E)» У t(a = рі У (шу =P. (ky 
x=k y=0 I — gt 


To find the mean and variance of the shelled distribution, we use logarithmic differentiation 


л „ ELEME TRE LIUR фэн s d 
WD (rge " от) со (6. - 7 }60 
G'(1) = k+(q/p); С"(1) = [k * (q/ p + [421 р?) - К] 


E(X) = G'(l)=k=(q/ р), Var(X) = G"(1) + С" (1) -[G'(DT =(4/ p) + (4/ P7 qlr 


) 
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14-51. Worked-out Problems 


. Aman wi ceys wants | 
Example - E 2 Z n keys wants to open his door and tries the keys independently 
ES not li і а Es and variance of the number of trials (a) if unsuccessful 
MEN NOU еппипагес from further selection, and (b) if they are. 


Solution. Denote the events : C; = {success at the jth trial} and let р, = P(C), 
(a) If the unsuccessful keys are not eliminated, then 
т 7 ы 
р = nq =1-п, р, =1/п, galen jon p;=1/n, q; TEL 
The probability of first success is a Pascal geometric variate : 
f(x) = д‘! p, x=1,2,3,...00. [p=n', q-1- p] 


L E(X) = 1/ p=n, Var(X) = q/ p? = п(п – 1). 
(b) If the unsuccessful keys are eliminated, then denoting the event A, = {first success 
at the rth trial}, we have 


Rs PIC y= bet 
=l n-r+1 


P(C,) = А Р(С,) = 


l 
n 


ENS 1) 1.1. - PG оул нз 1] (12 2] 1-1 
PA) = PC, C) -(1 1 P(A) = PE, б, C) - (1 Jit А ысыр 


...P(A,) = 1/п. Thus p, = P(A,) = 1/п, M tes], 2. but 
Now if R is the number of trials, then 


eer ith го 1&6 з (п+1 (201) 
E» Ero - r4 5j EG) Du p, iL SR À 


Var (R) = E(R°) -E'(R) = (n° - 1)/ 12. 

Example 2. Coupon Collecting Problem. There are m different types of coupons and 
each time one gets a coupon it is equally likely to be any of these types. Let X denote 
the number of coupons one needs to collect so as to possess at least one of each type. 
Find E(X) and Var (X). 

Let Y denote the number of distinct types of coupons in a collection of n coupons. 
Find E(Y) and Var (Y). 

Solution. Let X. denote the number of additional coupons required after / distinct types 
аге collected, until another new type has been obtained, j = 0, 1, 2, .... m - 1. Then 


Xu Xs td tai: 
ollected, each new coupon will 


Note tha yr 
t when ; distinct types of coupons have been c 
: - t so that X; ~ geom (p). Thus 


' à new-type coupon with probability р, = (т - pim, 
т-1 т-1 m 321 i 
E(X) - p E(X)- у? (7) "Ё i 


j=0 


SS D ose — —— 


Further, since each X, are indep. geom (pj), we have 


m-i 
T "e ds J m =m У, / T 
Var (X) = рар o: -х(2) TUNES 25 (m j» 
ji WF 
l, ifat б coupon is in the collection 
Second Part. Let Ү = | If a type у coup 


0, otherwise 
Then Ү = Y, d s d ok fS 
Write A, = (Collection of л coupons contains af least one type k coupon} 


^ P. ag m-lY 
P, = PA) - Le Ps 1=| 2) gie °-| т 1 


As Y, ~ Ber (Pj, we have 
E(Y) = Pj=1-a, [Q;2 1 - Pj = o] 
Var (У) = PQ; = a(l = о) 


Thus E(Y) 


У E(Y)2m(1-a) 
j=) 
Observe that Y, Y; is also Bernoulli (though Y, Y; are dependent) and thus 


P(A,A) = 1- P(A A) -1- P(A, UA) =1- P(A) - P(A,) + PCA, . A) 
= l-a-a+f. 


[В = P(A, Aj) = [(m - 2)/ т]", collection contains no types i and j coupons] 


Cov (Y, Y) ез EY, Y,) - EY) E(Y;) = (1– 20 + B) - (1 a? =B-0? 
So Var (Y) = У Маг (Ү,) + 2ZX Cov (Y, Y;) 
3 mal-0+2(3)B-a a eain - 1) (p - o) 
= ma + m(m —1) B- ma? 
where a = [(m-1)/m]", B=[(m-2)/ ml. 


Problems with Solutions Provided at the End of the Text 
1*. If My(t) = (5 – 4e), find P(X = 5 or 6}. 
2*. A throws a die repeatedly until he obtains a 6. Independently, B throws 4 die 


repeatedly until he obtains a 5 or a 6. If Z is the number of throws required >? 
both A and B together, show that 


k-2 k-2 
наем S(5] ^- 29) as. 
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А t X and У be iid. geom (p) and put Z =; 
< пах (X, Y). Find PIZ "WY s 
| E En. Р{Х= КІ2 = п), Р{(2 = піХ =k}, for all M P k fe s -- | ‘ 


w that the generating function of tl 
ү эрен fully the N cells is Ye number of balls that must be distributed 


N!0"(1-0)'" (1-20) ..(1- (N - DO], [0- t/ №), 
Exercise 14(a) 


(а) Two dice are thrown until a seven is obtained. Fi d 
h › Ом $ 
й Miei number of throws. ind the most probable — tr - 
ОФ Two dice are thrown until a six is on atleast one of them. Find the chance that for the first 
din са Six appears in the kth throw, k = 1, 2, 3, . [Ans. geom [11/36)] 
(a E decides to have children until ne эи а male child. What is the probability 
| of the children they would have ? If the probability of a male child in their 
is 1/3, how many children are they excepted to have before the first male child is 
| [Ans. 3] 
se an urn contains 10 balls of which | is black. Let Z be the number of the draws 
lacement, necessary to observe the black ball. Find the probability distribution of Z 
that E(Z) = 10. : 
= 
) An urn contains W white and B black balls. Balls are randomly selected, one at a time, 
il a black one is obtained. Assume that each selected ball is replaced before the next one 
гап. Find the chance that 
ae n draws are needed, (ii) at least k draws are needed. 
n сас! box of Daffodills-Cosmetics, there is a coupon with a number from | to 6. If a 
su ds in getting the series | to 6, he gets a gift. How many boxes must he buy, on 
ge, bef e he gets a gift ? [Ans. 15] 
тап is g keys of which only one fits his door. He tries them successively. This may 
T ERR Lin. 
А m^ (X) = 1.5, wehre X is a discrete r.v. with P(X = x) = 2/3", х= 1,2, 3, ... 
{ ymetric over 0, 1, 2, i: and f(1) = 3/02). Show that P(X is odd) = 0.25. 
iine the geometric distribution on positive integers 1, 2, .. . find the probability that ал integer 
Gi) xdd, (i even when ‘itis divisible by 3. [Ans. ql) "(deg 


occurri h time is p | 
P May autem is 0.6 that an odd number of flips is 


EET Cem 
b (XX s n) = E(X) + 1 +", for all positive integers н. 


-1, 0, 2, ... and d does not depend on с. 
oni stp tor fed x. Show hai maximum at p= Va r2 e 


н а 


and 
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11. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


h representing the number of failur: 


(a) If X and Y are two independent random variables, cac 
as probability of succes 


preceding the first success in a sequence of Bernoulli trials with p 
a single trial and q as a probability of failure, show that P(X = Y) = р/(1 + q) 
(b) If X and Y are indep. geom (p) variates, show that P(X = Y) = p/(2 – р). 


Consider a sequence of Bernoulli trials with a constant probability p of success in a singl 
trial. Let X, denote the number of failures following the (k — 1) and preceding the kth succi 
and let S, 2 X, + X, +... X,. Derive the p.d.f. of $, Find E(S,) and Var (5,). 


Let X and Y be independent geom (p) variates W = min (X, Y). Integer m 2 0. 
(a) Find the distribution of W. (b) Find P(W = X). 
(c) Show that Р(И= т, X —- Y=z} = p (1 T i (1 s where z is an integer. 
(d) Show that min (X, Y) and X - Y are independent. 
Let X and Y be independent geom (p) variates and Z = max (X, Y). Find 
(a) the distribution of Z. (b) P(Z s T). (c) the joint distribution of X and Z. 
(d) the conditional distn. of X gives Z = l. (e) the conditional distn. of Z given X - k. 
Let X and Y be independent geom (p) variates. Let U — min (X, Y), V 2 max (X, Y). Find 
(a Р(О= К, У= К+ р). (b) P(U=k). 
(с) Р(И- О = р) (d) Show that U and V — U аге independent. 
Let X and Y be independent geom (p,) and geom (p,) variates. Find 
(a) P(X 2 Y) (b) Р(Х = Y) (c) P(min (X, Y) =z} (d) P(X + Y=z). 
Each of two persons independently throw a coin until he obtains a head. Show that the 
maximum of throws has the following distribution : 
p," 0/2* ! -20/4*,  k=1,2,... 


A biased coin is tossed indefinitely. Let p (0 <р < 1) be the probability of success. Let Y, 
denote the length of first run and У, the length of the second run. Find the p.m.f.’s of Y, and Y, 
and show that E(Y,) = (q/p) + (p/q), E(Y,) = 2. If Y, denotes the length of the nth run, n > 1, what 
is the p.m.f. of Y, ? Find EY, ). 


Let X,, X, be i.i.d. random variables having positive mass at 0, 1, 2, ... Also let U = max (Х|, Х,) 
and V = X, – Х,. Then 
{P(U =j, V=0) = P(U=j) Р(У= 0) Vj} < (X, and X, are geometric}. 
Let X and Y be mutually independent variables, taking non-negative integer values. Then 
P(X <n)-P(X+Y<sn) = AP(X*Yzn) 
holds, for n =0, 1, 2, ... and same A > O iff Y is geom [AK(1 + A)]. 
Let X ~ gem (p). Show that E(x')=-0n [p - H 
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NEGATIVE BINOMIAL DISTRIBUTION 
= IK 
Bin Thm. (0-4) = У | а а 
x = () 


X 


Neg. 
^ d 2 k x-1 b 

This yields : 2 | x IL q =1; (p+q=1), hence the nomenclature 

14-60. Definition of Neg-bin Distribution 

A random variable X governed by the probability law 


Kekel) ki 
fes ex --[ asd Jota (p+q=1),x=0,1,2,..., f(x) = 0, otherwise. (1) 


Equivalently : f(x) = P(X=x)= bh p*(-q)', О<х<оо; f(x)=0, otherwise 
is called a negative binomial variate, and the above law is called the Neg-Bin Distribution. 
often indicated by “X is Neg-Bin (k, p)” or X is NB (k, p). 


x+k-1 Хе цах + К —-1) (4 +k-2)... (kK + Dk 
Note. E-— 1 — x ^s x! | 


(-D' (~k)(—k —1)...(-k -—x+2)(-k-x4+1) _ ру" » 
ooh Тен бе ааа Wil “САЙ | 
This proves the equivalence of two expressions in (1). Obviously, 


У ла) = È (0) са = paar =1 
х= 0 х= 0 


This shows опе reason why the distribution is called negative binomial. 


Bin-Similarity. Let p = 1/Q, q = P/Q [or Q = Ир, Р = q/p; so that p+q =1 >Q- 
P = |. The probability law (1) can then be expressed as a term of binomial expansion : 


P{X =x} = s] р“ fo) S NA Gav eu 5.5 Р(х) = 0, otherwise. 
Interms of Pand 0: È PIX=x}= X 5) оз: ву =(0-Ру* =1 
х= 0 х= 0 


-k)g-k-x x = 
Comment, X ~ NB (-k, P) if f(x) = e Je FAC oP) xw«012.. 


Physical Conditions for the Occurrence of Negative Binomial Law | 
* experiments (or trials) with the following properties lead to Neg-Bin distr у | 
* The result of each trial (experiment) can be classified into one of two disjoint 
categories, say success (S) and failure (F). 
e (success) = p, remains the same constant for each trial. 
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mes of all trials are independent of each other. 


3. The outco 
a variable number of times until a fixed number 4 


4. The series of trials is performed 
of successes is achieved. 


Note. Only the 4th condition differs from the conditions of Binomial distribution 


14-61. Two Forms of Negative Binomial Variate 
Form 1. (Neg-Bin) Let X, denote the total number of failures preceding the kth 
in a sequence of indepe7ndent Bernoulli trials. Then 
m+ k E 1 k m 
мос | =O} 1, 2, ... 

P(X, =m) = | Eei Jp q,m 
[X, = m is the number of failures preceding the kth success] 
Modelling. Let A = (In the first m + К — 1 trials, there are k — І successes}; B = {mth 
trial is a success}. 


Ssucce 


Then, P(A) = eek р“! 4" (Binomial law); P(B) = p (simply). 


- TW k-1 c om 
2. P(AB) = PA Pa -("1*. IL ор» шар )r'a , m=0,1,2... 


Note that f(x) 2 0, V хап Дх) = 1. 
Form 2. (Pascal Neg-Bin) Let Y, denote the number of trials required upto obtaining 
the kth success inclusive in a sequence of independent Bernoulli trials. The sample 


space of Y, is thus {k,k+1,k +2, ...} 
P(Y, =n) = pon)= SA pt q'^, n=k,k +1... 


[Y, = n is the number of trials required to obtain kth success] 
Modelling. Let A — (In the first n — 1 trials, there are k — 1 successes} ; B = {nth trial is a success]. 


P ] - n- Й . 
Then P(A) = m А pq (Binomial law) ; P(B) = p (simply). 


P(AB) = P(A) P «(1 1) p 7n x f(e 


Observations. Let X, = Y, — k, be the number of failures upto and including the kth 
success. Then 


*k-1 r 
Р(Х, =r} = PLY, =r +k) =’ E ) pta", for all = 0,1,2, Ж 


Remarks and Terminology. The term modified negative binomial distribution 15 often 
used to describe the variate X, defined as the total number of failures before the kth 
success in the Bernoulli process. As such, the term neg bin distribution is used to 
describe the variate Y, defined as the number of trials necessary to get the kth succes? 
(k > 1). However, we adopt the terminology X, ~ NB (k, p) and Y, ~ NB* (k, p) [called 


§14-70. Neg-Bin Distribution as Conv olution of Geom Distribution 45 1 
herein Pascal neg-bin distribution] and write X, Y instead or XY 
X, and Y, 15 clearly 

Y, =X, + К, or simply Y = X + к. 
it + k trials are needed to have Y, failures and k successes]. This relation may be 
verified by р. g.f. or m.g.f. ча Observe that 


- i. n. E +k-1 AS : 
P{X,=r} = Р(Ү, =) s "- ILE ! r=0,1,...for each k = 1,2, 3,... 


Comments. N-B distribution also arises when compounding some other probability 
laws. See Appendix to Chap. 19. 


bs The relation between 


14-70. Neg-Bin Distribution as Convolution of Geom Distribution 
Theorem. Let (Y;) be an infinite sequence of (indep.) Bernoulli trials, P(Y; = 1) = p. 
P(Y, = 0) = q = 1 — p. Let N, be the number of trials required to obtain the rth success 
denoted : 5, r= 1, 2, ... The following results hold : 


(a) P(N, = k) = pq. ', k=1, 2, ... ie. N, ~ geom (p). 
(b) Let T, = the number of trials required to obtain first success : S, 
T, = the number of trials following S, upto and including S,, 
Т, = the number of trials following S, , upto and including S,. 
Thus М = T, + T, +... + T,. Show that Т, are independent geom (p) distributed. 
k-1 RUE _. = r k-r = ; * 
(c) P(N, = k) = е = еу ДЕРЕ Ee N МВ * (К, p). 
Proof. Let X, =number of failures preceding the first success S, 
X, =number of failures following S, and preceding 2nd success S,, .. 
X, =number of failures between 5, _ ; and 5. 
IST -X *1,T,-X,-1, T, E= X, +; NE T, T). + T, = (3X) + г. 


(а) P(N, = k) = ee m KR P(Y, 20, Y, 20, ., Y, 420, Ү,= D 


Т; v 


= P(Y, = 0)... (Y, = 0) Р(Ү,= 1) = Mri 12,3... NU 
G(r: №) = Е(г@ “у= X(q pr y= Fy ( qty "Tis Iqti «1 962) 


©) We prove that T, and T, are gael ass The proof for T,, Ta ..., T, is similar but 
* notation gets voted. 


P(T, = m) = pq"! [by (1), since 7, = M] 
KT, -m, T,- n) = P(Y, =... SE m-| = 0, "n Bf = Imen-l - 0, aes = 1) 


= (q"^'pyq'p- utr. [By SP 
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[Total Probability Rule] 


m= 


P(T, =n)= Y PT, = Т, Т, = п) = р? и“ 4" = pq" 
Thus P(T, = m, T, = n) = P(T = m) P(T, =n) > T,T, are i.i.d. geom (p). 


(c) Git: N) = G(:T, +Т, +...+Т,) - [GG TY - [pt / (1 — 4D] . [p.g.f. of N- B^ (r, р)] ...(3) 


a P rü-dqy'-príc»y wg (qt)' 
х=0 


P(N, = К) = Coeff. of г“ {эы p (ay! (к) p "tur. pride 1... 


This is Pascal Neg-Bin distribution (r, p) ; rth success on trial k. 

Comments. That T,, Т,, ..., T, are indep. is obvious. In fact, since Bernoulli trials are 
indep. after achieving 5; _ |, the process starts over again as a new sequence of Bernoulli 
trials so that T, has the same distribution as T, which is geom (p). Independence follows 
since each of r.v.s. T, is determined by non-overlapping sets of indep. Bernoulli trials, i.e. those 
trials which occur after 5, , and including the trial at which 5, occurs. We conclude that 


Х = у х,=[Ў r--- L (T, = 1). (T, — 1) ~ geom (p) ; so X ~ NB (r, p)] 
yw [m y 


14-71. Probability Recurrence Formula 
If X is Neg-Bin (К, p) and f(x) is the prob. that there are x failures preceding kth success, then 


sofri ре — а (рат, 0€x«o. 


k -1 
HFD © re)! x 0 xk 
Tu Luc. queues. ngo. 


This gives the successive probabilities once we know f(0). 


Comments. Neg-bin as difference of two sums of Binomial Probabilities 


p(x)= (trol tag’ fei ИЕ Ex) 


Р(Х > x) = Р (more than (x + k) trials are required to obtain k successes) 


k-1 wt TE 
P{(x + k) trials produced fewer than k successes} = 2 C j ‘) ^q Ai 
j=0 


р(х) = P{X>x-1}-P(X>x}= У ^en JU A Capt gt 


j=0 J j=0 
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14-12. Worked-out Problems 


gxample 1. Find the probability that a person tossing 3 coins will get either all heads 
or all tails for the second time on the fifth toss. 


solution. p = P(TTT © ННН} = (1/8) + (1/8) = 1/4, thus p = 1/4, q = 3/4. 
Now, the number of trials X on which kth success occurs has the Neg-bin density 


З el 
fe = (5-1) а E sk, Eb .. 


Here x = 5, k = 2, p = 1/4, hence the required probability P is 


"(0 -2-& 
Tu TN лу А ate 396 


Example 2. Gamblers A and B, with initial assets a and b, play a game in which, in 
each play, A beats B with probab. р and loses to B with probab. q = 1 - p, 0 <р < 1. If 
each play results, in a forfeiture of $ 1 for the loser and in no change for the winner, 
find the probability that B will be ruined. [Attrition Ruin problem by Kaigh, Jan. 1979] 
Solution. Write E, = (In the first b + k plays, B loses b times). If every time that A wins 


is termed a success, then E, indicates the event that bth success occurs on the (b + &)th 
trial. Thus X is NB distributed. So 


k+b-1 | 
P(E.) E =, Jp a. k=0,1,2,....4—1 


If A* denotes that A wins, then P(A*) = XP(E,) and so 
a a dh УГ 
Р(А*) = X | a IL q. 
k=0 
Note. If a = b = 4, p = 0.6, q = 0.4, the P(A*) = 0.710, P(B*) = 0.290. 
Example 3. A marksman is required to shoot at a target until he scores 5 bulls’ eyes. 


е probability that he hits the bulls’ eye on any trial is 0.3. What is the probability 
that he requires 8 shots ? 


Solution. Here = 5, р = 0.3, x = 3 (the number of failures preceding the 5th success, 
55 k + x = 8). Here by the above relation [$ 14-74] 


ро = E (Jes on"! X ()es' on" 


j= 
= 0.971 – 0.942 = 0.029. fusing binomial tables] 


Уре, The above solution is only to illustrate above comments. The result follows 
"Мау from (1) : 


p(x) = 7C, (0.3) (0.7) = 0.029. 
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Problems with Solutions Provided at the End of the Text 
1*. If a boy is throwing stones at a target, what is the probability that his 10th throw 
is his 5th hit, if the probability of hitting the target at any trial is 1/2. 
2*. A machine is known to produce 3% defective items. What is the probability that 


е7 


at least 5 items аге to be examined in order to get 2 defective items * 
14-80. Generating Functions 


= 3 = ‘ae; = k+) -1 x 
Gt) -E( = X fot LE =p > | ч Ja 
x=0 | J 


x 


= p'(1- qt)* = [p/ (1. - aD] 
Mt) has been obtained in $ 8-16. This is given by Мү(ї) = [p/(1— qe^)] . 
For the Bin-Similarity, put p = 1/0, а = P/Q, (Q - P = 1) М) = (Q – Ре)“. 
Example : Show how the moments of Neg-Bin variate can be written down from the 
corresponding formulas for the binomial variate. 
In Bin-Similarity, the comparison is quicker. 
Solution. 
If Y is bin (n, p) and X is N-B (k, p) then M(t : Y) = (q + ре)", M(t : X) = (Q - Pe’) 
Thus the correspondence between Y and X is : q €» О, p €» — P, n €» -k. 
The moments relation are thus as under. 
Binomial variate. р = пр, р, = пра, у; = npq(q—p) і. = npq (1 + 3npq - 6рд). 
Neg-Bin variate. y = КР, y; = КРО, р, = КРО (О + Р), р, = КРО [1 + ЗЕРО + 6РО]. 
In terms of р, q. Put P = q/p, О = Ир. Then 


Neg-Bin variate : p = р Hs E etc. 


14-81. Reproductive Property 
Let X, (i= 1, 2, ..., n) be independent Neg-Bin (k; p) variates. Then S, = X, + X, +... + Х, 
is Neg-Bin (А, +k, +... + k,, p) variate. 

M(t: X,* X, * .*X)7 Mt: X). Mtt: X) .. M(t: X) 


p k p к, р Ёё р К 
- eri {чы ud [5]. eno 
Thus (X, + X, 4 X) ~ NB(k, +k, +... +k,, р). 


14-82. Mass Relations between Binomial and Neg-binomial Distributions 
Let b, (n, p) denote that X is bin (n, p) distributed and NB, (k, p) denote that Y is 
NB (k, p) distributed. Then the following expressions are true : 


k 
1 a = | b ,b), =k, k E; 
(i) NB, (k, p) -( y Ob), y * 
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k 
(ii) МВ, (А, p) = EAL tk pP, xz0.12.. 
(iii) geom, (p) =(I/y) bj, р), у= 1, 2,3, ... 
(iv) geom, (p) z [1/01 я" x)] b, (x + 1, p), т Doe "2e. 


Proofs are immediate ; e.g. we prove (ii), 
k ttaka k [x*k) . ilke l 
psu ep - er П А q - "py IL а = МВК): 
Example : Let f(x) = P(X = x), x = 0, 1, 2, ... be the p.m.f. of a r.v. X. 
If (x + 1) f + 1) = (a + bx) Дх), V хапа b = —1, show that 


2 
E(IX-pul) = LN where ep АН (H < oo). 


Note. Bin (л, p), Pois (А) and NB (К, р) etc. obey the stated chain relation. 


Solution. Here 2. ЈО) = RF (c D f(x+1=0 £(0) +1. f(1) +270) +... = Ух f(a). 
0 0 


Randomizing chain relation Xxf(x) = X(a + bx) f(x) gives 
E(X) = a+bE(X) > (-b)EX)-a > р=а/ (1-р). Ino 


We can even find variance, we have 


Ух(х + )Дх+1) = ax Дх) +b Ex Дх) 


i.e. E[(a-1?-(Q-D]f(x41D = aXxfQ)ebEx (х) 
Thus, E(X?)-E(X) = aE(X) + bE(X?) 
So E(X’) = (14 à) u/ (1 b) = а(1+ a)/ (1 - by, [by (1)] 


Var (X) = E(X?) -E (X) = a/ (0 - Dy. 
Mean Absolute Deviation. М = E{| X - yl]. 


© m-1 o0 
EX - ul] = Xlx- ш/о) = X (и х) ЛО) + X (х) SO), (ee PA ERI 
0 0 


т 


0-E(x-g)e X (х-н) о) + G-1fG) 
0 m 


Adding these equations we get 


Etat ex ESSO 
or м = 773 D(x bx) fo) by (0 ed 


(1° )м = Sfx) - (х +1) fix + 0] [By Chain relation] 


xam 


m YIx fG)- (e+ D /(х +1] 


li 
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= lim (m f(m) - (m*n* 1) f(m+n+1)} 


n> oo 


= mf(m),[lim n f(n) = 0, nec. condition for convergence] 
Thus M -2mf(m)! (1 — b). 
Exercise. Extract the value of M for bin (n, p), Pois (A) and NB (k, p). 


14-90. NB-Distribution as an Extension of Geometric Distribution 


Let Z, be the number of trials to the first success and Z, be the number of additional 
trials to the second success, Z,, the number of additional trials to the third success, 
and Z, the number of additional trials to the kth success. If Y, is the number of trials to 
the kth success, then we must have 
Fo Dy + 242, gt 21. 

We know that Z, is geom (p). So Z, must also be geom (p), because the Bernoulli 
variates involved are independent which guarantee : 

P(Z, = 1) = p, P(Z, 22) = pq, vs PZ =) = PT 
The same reasoning applies to Z}, 24, ..., Z, ; i.e. each of Z; is geom (p) and they are 
independent. The fact embodied in Eq. (1) then says that the sum of k indep. geom- 
variates, each with parameter p, is a Neg-bin variate with parameters k and p. 
The result also follows by m.g.f. technique. Since 7, are i.i.d. variates 


E 1] 


M(t: Ү,) = M(t:Z, +Z e. Z2 ME: ZN =[p/ 0 - ge]. 


This shows that Y, ~ Neg-bin (k, p). 

Remarks. Repeated use of Eq. (1) shows that the sum of indep. Neg-bin variates with 
the same parameter p is again a Neg-bin variate with parameter p. Nicely, for this 
closure property, m.g.f. method provides the proof instantly. 


14-91. Poisson Distribution as a Limiting Case of Neg-bin Distribution 
If X is Neg-bin (k, p), then as д — 0, k o» such that kq = A (finite), then X tends to be 
Poisson distributed with parameter À. 


k eye -k 
| р ) =) h1- 
1 - qe' pM p 
-k 


M(t) 


| 
ae 
—_ 
| 
>» 
T 
= -~ 
| 
—- 
— 
— 
|- 
ку 
ко d 


Ш 
3 


A (e -1 о рУ | 
ро.) ын MED а-а] =eM'-D [mgf. of Pois 0) 


The unique correspondence between m.g.f. and the p.m.f. now provides that N-B (k, P) 
tends to be Pois (A) distributed. 

Note. The result can also be established by considering the limiting behaviour of 
Neg-bin p.m.f. 
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14-92. Normal Distribution as a Limiting Case of Neg-bin Distribution 
If X is Neg-bin (n, P), then M(t : X) = (Q — реу" 


Let Z = (X - nP)/ JnPQ : Where E(X) = nP, Var (X) = nPQ = с“, (Z is standardized). Now 
M(t: Z) = M[r:(X-nP)/o] - e" М/с: X] 
= pts EE Pe"? ) NR a - (Qe ,Ptla - pe"? ) n (1) 
We now use exponential series to obtain 
Pp PS p 2 "P 
У р ар е Р TUIS a mm Mow’ Bid 
w Am 60 ee 6с | 


1 —(t?/2n) - PQ(Q + P) 17/603 +... AM) 


Qe” – pe?" = o | * 


Substituting from (ii) into (1) we obtain M(t : Z) = [1- (2/20 + О(1/ n. 
2 =n | 
lim M(t:Z) = lim [ Lg o(1) ze [Euler limit] 
no пэ о 2п п 
It follows that Z tends to be №(0, 1) distributed when л is large. 


14-93. Mean (Absolute) Deviation 
If X is Neg-bin (k, p), the M.a.D say, M is 
M=E(IX-pl)= x f(x). (u-x)+ L(x) (х-н), [= к/р) 
x> р 
Also : ею е. EN (x - 104 Ло) (ж-н). 


x«pn 


Adding these we get, using A = [u] 
k-x-1 ч k 
M-2XYf06-0-2 Y ( Jp (=-=) 


f 
z ;M AIRMAN —(x+k)q**'] Г: р= 1 ~ 9] 
ЕАБР] 
"ail ct? "zu: |^ Sara 
М = 2p*' д" ТТЕП E 2p"! ёа 1) 


Remarks. In allied notation, p = 1/0 and д = P/Q, the above result is 


М = е чым o» (141). А = [ЕР]. 
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14-94. Worked-out Problems д 
Example 1. A couple with 2 daughters plans to having mm until they have 2 
sons. Determine the probability that the couple will have at least 2 DEI giris before 
attaining their objective. What shall be expected size of the family then | 

Solution. Let X be the number of additional girls born (i.e. failures) before (ће couple 
gets two sons. Then X - NB (2, p). So 


P(X 22) =1-P{X<2}=1-[P(X 20) + Р(Х = D] 


- 1- p - (2) ра = 1-р 24р". 
The expected size of the family, with already 2 girls, is 
N =2 + E(X) +2 = 4 + 2qlp. 
Note. If p = 0.51 (probab. of a male child), then Р(Х 2 2) = 0.489, N = 5.92. 
Example 2. Let X be bin (n, p) and Y be NB (r, p). Show analytically that 


Fy(r- 1) = 1- Fy(n-r). 


M lm b = a+b 
Solution. Recall : H-G identity : » КИЕ e (I) 
Negative bin-expansion : (1 ~ у= У p pro 24 i. AA) 
ј=0 


Н = 1- Еу(п- г) = Р(Ү>п- ғ) = $ dores [Put y 2(n-r*1)*1] 


yen-r*l tal 


ph Го E "E Z cC а 
E dir adi bei [Put p 4" "* = A,usea=n,b=t,m =r — lin (1)] 
t=0 


ai је ECL 


1 
"S 
X 


11 
d> 
> ~ 
Ш 
| „Ма 
Lepus. 
os 
engem SINCE ©: 


-|loal(r-ktj-l) ; 
Deel М Je} ЕТИЛ 


r-i 


r-l 
-pq У (1) "Каур а, [by (2)] 


k=0 k=0 


P(X &r - 1] = F (r-1). 

Remark. Non-analytical proof considers equivalence of event-sets. 
Comments. Let X — bin (n, p), Y ~ Pas (r, p). Then 

(1) P(Y £n) = PiX2r), (ii) P(Y » n) = P(X <r}. 
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ООО ы о —  _—_—— —- — ыи а 

Example 3. (Banach Match-Box Problem). A pipe-smoking mathematician carries, at 
all times, two match boxes, one in his left-hand pocket and one in his right-hand 
pocket. Each time he needs a match he is equality likely to take it from either pocket. 
Consider the moment when he first discovers that one of his match boxes is empty. 
Assuming that both match boxes initially contained N matches, find the probability, 
that there are exactly k matches in the other box k = 0, 1, 2, ..., N. 

Solution. Let A denote the event that the mathematician first discovers that the left- 
hand match-box is empty (naturally discovered in N + 1 trials on L) and there are k 
matches in the right hand box at that time i.e. (N — &) trials on R. Now event A will 
occur if the (NV + 1)th choice of the left-hand match box is made at the (N + 1) + (N — X) 
trial. Hence from Y ~ NB* (r, p) with р = 1/2, у= 2N-k+1,k=N+ 1, we get 


А 2N - kl 
nae I 


If B denotes the event that he first discovers that the right-hand match box is empty 
and there are k matches in the left-hand box at that time, then by symmetry, P(B) = P(A) ; 
hence the probability P of the event of interest is 


2N-k 
P(A B) = P(A) + P(B) = 2P(A) = pa t) @ 


Problems with Solutions Provided at the End of the Text 


1*. If X ~ NB (k, p), show that the moment recurrence formula is 


Ou, rk 
He,=7 ag yc : 


2*. If X is Neg-bin (k, g”), show that 


ji P х"! dx 
> т} = =— | ————,. Р = 1). 
P(X 2m) Bim, k) is (1 4: фа (Q ) 
3*. Let X ~ NB (k, a/(a + г). Find the density of zero-truncated distribution and 
express k and a in terms of p, ру and p3. 
4*, 


In a sequence of indep. trials, the probability of a success on each trial is p. 
By considering the outcome of the first trial, show that G (t) : the p.g.f. of the number 


of trials required to achieve the rth success, satisfies С (0) = pt G, (0) + qt G, (t). Hence 
obtain G, (r). 


Exercise 14(b) 
1. State a parametric family of distribution [u = E(X), Var(X) = с>] which satisfies : 


@)ц>в? (b) u-o? (с) р<о°? (d) и<,=,> 6? (for different values of parameters) 


> To determine who pays for cofee, three people each toss a coin and the odd person pays. If the 
Coins all show heads or all show tails, they are tossed again. What is the probability that a 
decision is reached in five repetitions or more. 


р = 


PI os 


10. 


11. 
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Suppose that you believe that you can hit a bull's-eye with a dart І time in 10. If this iş (is 
case, compute the probability that more than 100 throws are required to obtain exacti, i 
bull's eys. А 
An item is produced in large numbers. The machine is known to produce 2% defective, A 
quality control insepector is examining the items by taking them at random. What is the 
probability that at least 4 items are to be examined in order to get 2 defectives ? 
If E(X) = 10 апіс, = 3, can X have a N-B distribution ? 

If X is NB (k, p) and E(X) = 20, Var (X) = 180, find k, p. 

If X is Neg-bin variate with parameters k and p, show that, 


(i) Mz, = (kq/ p) н, — q (Op; / др). (ii) ke = q (dk, Гар) 


The number of accidents among 414 machine operators was investigated for three successi. 
months. The following table gives the distribution of the operators according to the number 
k, of accidents which happened to the same operators. Fit the distribution of the type 


Р(Х =k) = CD (79) реа": к= 0,1,2, ...0>0;9=1-р;0<р<1 


k 0 1 2 3 4 2 6 7 8 
Obs. freq. 296 74 26 8 4 4 | 0 1 
If X is N-B (k, p) and F(X) is the c.d.f. of X, then prove that if (kp/q) is a positive integer, then 
F(kp/q) > 1/2, if р < 1/2. 

1 Ш» жә 
Р : > = kal feast B 
rove: Р(Х2 т) = = m b р y'd-y)""! ау. [X - NB(k, р)]. 

Let X and Y be independent negative binomial variates with parameters (k,, P) and (k,, Р) 
respectively. Show that the conditional distribution of X given X + Y = n is negative hyper- 
geometric distribution. 


PUN B(x+k,, y+ k) 
x B(ky.k) 


You can only be young once. But you can always be immature 


seieieieeieieleieeldmeeleieleieieieieeeeemilaeememeee 


What makes the desert beautiful is that somewhere it hides a well. 


More Discrete Distributions 


15-10. Discrete Uniform Distribution 

Definition. Let A, = {a,a+1,a+2,...,b}, where b =a +n- l,a e К.А г.у. X is said 
to have a discrete uniform (or rectangular) distribution over A,, written X is u(A,), if its 
probability mass function is given by 


n? 


ymo sls VxeA. [nzb-a-l) f(x) = 0, otherwise. 
Obviously, P(X є B) = Y(l/n) V x є B, [(points in B)/n] 
Remark. This distribution is the basis of equal-likelihood for elementary problems. 
15-11. PG.F, М.С.Е, Mean and Variance 
Git: X) = Et) en Xt 2 Q7 177 1 )In 


= t*(1—1")/n(l- t). [nz b—- a ^ 1l] pos BD 
M(t: X) = e"(1-e")/nü - e). [t — e' in (1)] «d 
M(t) = e"(e" – 1) /п(е – 1) 
= (1+а+ iar + „)(т e 3:98 + ene + - {n(t+ hr rib mn 
= QUIT SPRNITEPET EMG 
- (аап) + (ja nad)? e] Mosen Pur YR Wr dis 
2 
р = Сое оѓг=а+ 1(n-1) - (a )/ 2; н; = Coeff.of 5 21 - (adn) + (a +na+ n) 
в = p-p? [аи азн? -1ned]- eio n] 


F TRE E = A Aa - a «20-2112 


Direct Evaluation of Mean and Variance 
T Е(Х) = (1/п)[а+ (а +1)+...+(а+п- 1) =а+ 2 (п – 1). 
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E(x?) = (1/n[X(a - k-?]2 (1/m) Ха – 1)? *2k(a-D +), (1<К<л). 
= (a-W + Ya- 1) (У) n+ (52) /п= (а – 1} + (а – 1) (п+ 1) + (n+ 1) (2л + 1) /6, 
Var (X) = E(X?) -E?(X) = (a – 1)? + (a - 1) (п + D) + 2 (п + D) Qn +1) – (a 1) + Gi yp 
= (1/6) (n 1) (2n + 1) - (1/4) (п + D? = (и? – 1) /12. 


15-12. Worked-out Problems 
Example 1. Show that if X, Y be identically distributed with common p.m.f. : 
P(X-2k)-WMN,fork21,2,.., № (N» 1) [X is uniform on (1, 2, ..., Nj] 


then Corr (X, Y) = 1— (6E(X -YY /(N? -1)). 


$ NON Y 1. Nri 
d 


РТУ =E(Y) [by symmetry] 


N N 
Solution. Here E(X) = v gue. > i= 
pep N UNTER] 


Е(Х?) = xk? .0/ №) = (17 №) EK? =(N 4 DON 41/6 
Var (X) = E(X*) -E (X) = (№ - 1)/12 = Var (Y) 


eee =) = Er- А-КЕ ЕИО ЕХ YES [X = X— n. YS =Y -yl 


E(X- у) = 0? 4 0? —20 yy = 2065 —Gyy). [o, 2 0y] 
2o? -E(X-Y) ., 6E(X-Yy 2 
БОИНША АСИСТ ЕЕ LAE) рхи 


ЗБ 20% mn (№ -1) 
Example 2. A pair of N-sided fair dice is thrown once. If X and Y are the random 
outcomes on their eyes, find the density function for Z = X + Y. 
Solution. Here Z = X + Y; we need find Р(2 = z).ffz2x + уапі 1 <х< №, 1 &y € М." 
follows that 2 € z < 2N. Now | 

РХ +Ү= 7} 82, PX=x, Y=z-x) I 

As x#0,y#0andy>0,soy=z-x>0 > x<z<z-I. 
Further, М = max y = max (z - x) = тах z – min x = тах z - 1, hence max z = 1 + N, and 
so 2 <z < (1 + N). Thus Eq. (1) is valid only over part of the sample space; so 


P{X+Y=z}= X PX = xY-2z- у= У РХ х) Р( = ~ or (21.1) 


m) 


where we have used the indep. of X and Y and also equi- probable (discrete ли 


model for calculating probabilities. The constant (1/N^) occurs (z — 1) times In 
above summation, and so 4 
P{X+Y=z)=(z-1)/N, 2<z<(1+N) „© 
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Now consider the rest of the sample space given by 
(| + 2) < 2 < 2N. We observe that the sample space 
for X + Y = Z is symmetric about the main diagonal 
AB :x* у= N + | (See figure). St. lines x + y= N+ 2, 
and x + y = N are reflections of each other in AB and 
soare x x ye +3 and x - y N- 1, ... . Finally the 
reflection of (N, N) in AB is the point (1, 1). [Any 
typical point z = (x, y) = x + y reflects into z', such 
that z + z' = 2N + 2]. The relation of points above 
and below the diagonal AB is thus z' = 2(N + 1) - z. 
To find p.d.f. for the range N + 2 < z < 2N, we first 
observe that the following hold : 


P(X + Y2z) = G' -1J/N, 252 «(N 1). 
Using the above symmetry 


XN-1-z-1 QN-«D-z 
№ № 
To summarise, the density function of Z = X + Y is given by 
fiz) = (z-1)/ №, 2xz«(14 М); f(z) =[(2N + 1) – zi №, N+2<z<2N. 


Note. Probability mass of the diagonal line could be transferred to the range 
М +2 <z<2N. The density in this case is equivalently given by 


mee P(2Z=2)= P{X + Y =z}= 


vt 2S Za2N. 


(z- D/ №, 2<z<N 
(2N+1-z)/N*, N+1<z<2N 


One can verify that the same results are obtained from the two formulae, etc. 


Pizeai=| 


Problems with Solutions Provided at the End of the Text 
1*. Let X and Y be i.i.d. uniformly distributed variates over (0, 1, 2, ..., №). 
(i) Find P(X < Y), (ii) Find P(Z = z), where Z = min (X, Y) 2 X ^ Y. 


2*. n observations are drawn independently and at random from a continuous distribution. 
Find the chance that the next observation is the minimum of all the first л observations. 


Exercise 15(a) 


l. Let X be uniformly distributed on (0, 1, ..., 99}. Calculate 


(a) The c.d.f. F(x) (b) P(2.6«X < 12.2) 

(с) Р(25 € X < 30) (d) P(X 225) (e) P(8 < X € 10 or 30 < X < 32). 
2. Let X and Y be i.i.d. U(0, 1, 2, ..., М} variates. Find 

à). PQcs Y) (ii) P(max (X, Y) = 2}, (iii) P( 1X — У1= 2). 


3. Let X be U(0, 1,2, ..., N}. Show that (a) Coeff. of variation = [CN + 2)/3N]'”, 
(b) Coeff. of skkewness=0, (с) Coeff. of Excess = -[1 + 2/N(N + 2)/5. 
4. If X is uniformly distributed over (0172; NT. prove that 


2r 
ANTA ee | oe 
Ho,-1 =0›н»= уут 2, (2-15) ; "LI M 2, 
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15-20. Hypergeometric Distribution (H-G Distribution) 
Definition, A random variable X possessing the probability law : 


P(X = х) = f(x) К E max (0, n —- (N - M)) S x € min (M, л)" 


X nA 


(CS. Deren ' 


is called a hyper-geometric (H-G) variate. See Figure below. The distribution (1) is 
called the hypergeometric distribution. We often write "X ~ H-G (N, M, n)" to indicate 
that X has the probability law (1). The three constants N, M, n are known as the 
parameters of H-G distribution. 
Note. As x + M or n, we must have x € min (M, n}. Also x > 0 and N- M 2n - х, ie 
x> п N + M, hence x > max (0, M + n — N}. We conclude that the possible support of X is 
max (0, M +n- NJ &x € min (M, п) 15412) 
For x not satisfying (2), f(x) = 0 in (1). 


Physical Conditions for the Occurrence of H-G Distribution 

The trials with the following properties lead to the H-G distribution : 

1. The outcome of each trial can be classified into one of two disjoint categories, say 
success (S) and failure (F). 

2. Outcomes of successive trials are dependent. 

3. The probability of a success changes from trial to trial. 

4. The series of trials are performed a fixed number of times. 


Physical Model for H-G Distribution 
From a population of size N (finite number) M elements 
are of type A and N — M are those of type A’. Given that п 
elements are withdrawn at random from this population 
without replacements, show that the probability that 
exactly x of the n elements are of type A is 


poy «(1-09 


Proof. From the figure, we observe that there are Жо, ways of choosing x element 
from M elements composed of the sub-population A, followed by ^ "PC, | independent 
ways of choosing the remaining (n — x) elements from the sub-population A'. By the 
Principle of Sequential Counting, the total number of required selections 15 


[C 1 ud "The exhaustive number of possible withdraws 15 yee Thus, the probability 


x na 
mass is, 
* We can take x = 0, 1, 2, ..., n, because Р(х = n) = 0, unless x є min (M, n}, 


because C) z20ifk»r orifk«O 


$1 5-22. Proba bility Mass Recurrence Formula 46 9 


O 
, _(M)\(N-M) /(n 
Ax) :U Jl n-x y. me, |, 2, 
Remarks. (1) fix) 2 0. M) NfG)-1 V xe [max{0,M +n- N}, min{M,n)] 


The (ii) follows instants from the following H-G identity 
УЗ m N-M N 
ACRI n-x = (N) 


15-21. Structural Similarity between Bin and H-G Probabilities 


fx) = i | SRAN х= 0, 1, 2, ..., п 


N N! _ NY 
mee: |z = kKN-k) ky Then 


N (x) М, (n- x) ! N. (x) N (n-x) 
fix) = T ar ar = (ep wa [Factorial exponents] ...(1) 
s may N RK ‘ N x 
b(x) = (")p q 0 cae x =0, AN "ys 


Thus, ordinary exponents, when changed to factorial exponents, bin (n, p) converts to 
H-G (N, M, n), (p = M/N) and conversely. 


15-22. Probability Mass Recurrence Formula 
If X is Hyp-geom (N, M, n), we have 


f= DA. fer SCC) 


Бб) 
Dividing , C+D _\х+!Дл-х-1/ (M-x) — (-2) 


fG) (M\(N-M) (x+!) (N-M-n«x«l) 
Sa Awe 
M-x 


Th ~ Que x) 
* ДХ) = Co WoM-—ntxt) 


Note. if y — оо. (MIN) — p, this formula gives 


f(x). | UD 


fx 4*1) = de TIL [Bin-density recurrence formula] ...(2) 


P (1) and (2), it follows that Hyp-geom (N, M, п) — bin (n, p) under above 
itions. 


i 
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15-23. Modal Value 
For the positive integers N, M, n, let Ө = 


(n + 1) (M + DN + 2) 1) 
and let С be the unique integer satisfying 6-1<¢<9, i.e. CS SL tL. 
(a) If £2 0 (i.e. Ө itself is an integer), then the H-G densities satisfy 
Po <р. S = Pe, and Pe > Pe-1 > +> Pm [m = min (M, n)] 
(b) If £20 (i.e. Ө is not an integer), then 

Po = Pi < Pe апа Py > Pear Z P Pm: 


In either case I(G/n) - (M/n) «1/n. (2) 
Proof. By Mass Recurrence Formula [$ 15-23 (1)], p, = ХЮ 
fk) . (M - k) (n — k) (3) 


fü) | (k-D(N-M-n*k«l) 
Hence, [f(k + 1)/f(k)] > 1 yields 
(M —k)(n—k)>(k+)([N-M+1-(n-k)] > TEN D(M+1)-(N+2) 
is. k«[(n 4 D) (M-1/(N -2)]-128- I. 
Thus, P, < руу, for all k < O – 1. By considering р. < P, in (3), we get that Py >р, 
V k > Ө – 1, of course, with k < min (M, n). We have thus proved that if O is an integer 


Po € Py <Р» <... Doi» ANd pg > ре, >...> р„. 
If 0 is not an integer, then with the unique integer G as defined, 
Po < Pi € «p, and Pe > Pe, >> p, 
because if Ө is not an integer, the relations k < 0 — 1 and k > Ө — 1 are equivalent to 


k€G- land k 2C, respectively. Consequently, to prove the result we need to show that 
Po-17 Po» Whenever Ө is an integer. For this, put k = Ө — 1 in (3) to get 


Воз. (M-895D(n- 0-1) 
Po-1 Ө(М- М -п+Ө) 


Putting for Ө from (1) in various terms of (4), we observe that 
M+1-0 = (M+1)(N-n+1)/(N +2); (n+ 1)-8=(n+1)(N—M+1)/(N +2) 
N-M-n+® =(N-n+1)-((M+1)-0]=(N-n+1)(N—M * D/(N +2). 
Substituting for Ө and the above three evaluations in (4), we find that (p, / = 
1.е. Dg = рө, as was claimed. 
To estimate the quantity : (б/п) -(M/ М), we observe by minor algebra 
С<0<6+1 > (б/п) -(M/ N)&(0/n) - (M! N) < (5/п) + (1/ n) -(M / N) 


(4) 
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We rearrange this chain as 
(0/n) - (M/ N) – (1/п) «(6/ n) - (M! N) x(0/ m - (M / N) TAS 

(1) (ii) (iii) 


Gii) = ММ +n+1)-2Mn n(N- М) + M(N-n)* № 


п Аа lta АЦА NH. 
nN(N + 2) n(N? + 2N) 


BB n. rar, ui 


п(№ +2N) "М? +2№) n 


Есу, (iii) is positive [see last fraction іп (6)] and less than (1/n). Also, (i) is 
smaller by (1/n) than (iii). Hence, the above estimate of (i) implies that | (i) | < (1/n). 
And this proves our assertion (2). 


15-24. Simple Factorial Moments. Mean and Variance 


f(x) = Nr | A raD, Bihan TET 


EB = куа"? 


xr (7 C/C) 
= cin È ce у) 
«own re AE) cc unen 


N N- 
We apply H-G identity and also replace HE x | ul Thus 


nr 
Aa 1 s + № – Ó 
E(x} = NO  (N-r n-r 

{Жо а 
Ш, = (Np) .n'? / NO kkt) 
E(X) = piy =(Np)n/ N = np 

А Мр)(Мр-1).п(п-1) NM npp- DD 
T E[X(X -)] = COCOS => EX’) wl N-D | 


p. 
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E(x?) -Е?(Х) E * VP E — np) 


Var (X) 


= We O7 n9) = X 1 (N-n) = = (npa) | “N-D f 


Cor. Factorial moments of bin (n, p) from HG(N, M, n) 


cy №(М№р = 1)...(№р- г + 1) 
` NIN - D..(N-r«41) 


reo o3) (0-5) 30-3) 0-)) 


Li 
Щу = п 


Let № — oo, then lim Що =n р" 
Note. М® = DAT A (Base)! 


(№ к!) k!) (Base - Power)!’ 
Illustration : Find the S.D. of the dist f(x) = “С, 6C, ,/? C, x 20,1,..,4. Here 
X ~ Hyp-geom (10, 4 ; 6) ; so c? = 64/100. 


15-25. Relation of H-G Distribution to Hypergeometric Series & PG.F 
The definitions and some relations between increasing and decreasing factorial powers are : 


Def. : n? = n(n-1)...(n-k4 1); n =п(п+ 1) (n 2)... (п+ k — 1). 
Reln. : n? = (- Cm), п (пт), N"-9-2NOJ/(N na xy, (10) 


The p.m.f. of H-G distribution can be converted into decreasing factorial powers : 


f(x) = п“ .(Np? .(Nq)^-? 1 x1N'. [$ 15-21(1)] ...(2) 

The Hypergeometric series is 
ji | d oap,  o(o* DB(B 1) г? t у 145 2 of} gl? i* 3) 
Y Y y xD» 21° ia yl! Ni 


Put а = ~ и, B=- №, у= №мӯ-п+1; then using (1) the Eq. (3) reduces to 


[x] Ul wae x x 
il г) = В А оа ee IND P 
Y х=1 (Nq- n 1) 1 х=1 (Nq — n 4 xy? x! 
| -n, Np 


Nq-n+1 


[by 1(a) & 1(b)] 


М п n? (Np)? .0№)" р" A М? 
| E bra (Nqy? Xr > (N. 0)? EE TM^. Aby 100) & (2)] 
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3 oe) Laan, Np 
Gif) = Zt D |р , I 
I» 2, NU М№М-п+ 1 


1! ...(4) 
J 


Thus, f (x) is the coefficient of г in a constant multiple of H-G Series. 
Incidently, (4) is the p.g.f. of H-G (Np, Nq, n) distribution. Obviously 


(N — M)'(N —n)! il -n, -M 


M(t: X) = N! NUM n+l 


e [Change / to е in (4)] ...(5) 


15-26. Approximation to Binomial Distribution 
When N > © and (M/N) = p, H-G density tends to binomial density. 


"nw 
Proof. Here Mia). = + PAPEN "i" 


Np)  Np(Np-D..(Np-x*l1) pN* | Hd | ey 

E BENE nU 0m PN (р (p-2).. eee wi 
ч) е) 6-87 С 
E ~ (n- x)! ЯА Nee N (3) 

N N(N~1)..(N-n+1)_(N)"(, 1M, 2 лар) 

М 3 n! eed det N ma 


Substituting from (2), (3) and (4) into (1) we get 


...(5) 
xl(n—x)! (1- N)0-2N7)..[I-(- DN] 


s 


1 n ПХ х 
lim f(x) эй ("\4 bp Os xen. 


Note. In sampling with replacement, the probability of successive successes decreases. 


15-27. Worked-out Problems 
Example 1. Let X; 1 <j < п be i.i.d. Indicator (i.e. Bernoulli) variates, P(X, = 1) = p, 
P(X, = 0) =q=1-p.If S,=X,+X,+...+X,, find P(S,2rl$, = т). 


Solution. Here G(t : X,) = E(t™)=q+ pt; G(t:S,)=(q + pt)’: so S, ~ bin (k, p). Now, 


5, = т gives 


IX LEX eso) 4-5, XL, >т. 


There are r successes in k trials [S, ~ bin (k, p)] and m — r successes in n pki trials, 
S, ~ bin (n — k, p)], hence by independence of 5, and 5, _ binomial variates 
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P{S, =r,S,_,=m-—r} = P(S, =r) PS,-,=m—") 


k к-г of n-k m-r _n-k-m+r _ k n-k m n-m 
T Br P inel 4 HMM. 4 (1) 


P(S, =ғ15, = т} = P(S, 2r, $, , =m-r} P(S, = т) 


К n-k m п-т n n-m om _ k n—k n „ёл о P 
„(Ж ж)” 4 ПВ; Р (5s) Sn,Vsrsmsn. 


We observe that the conditional probability is independent of p and obeys H-G probability law 
Remarks. The following example is a repetition of above in a popular brand of exercises. 
Example 2. If X and Ү are independent binomial variates with parameters 7, p and 
ans р; find P{X =rl|X+Y=k}. 

Solution. Recall that X + Y ~ bin (n, + n, p). Now using Indep. (X, Y) 


P(X-2r,X«Y-k) P(X-rY-k-r). P(X =r) Р(Ү =k-r) 
P(X+Y=k) Р(Х+Ү =) P(X +Ү =k) 


п ги k-r хп —k+r 
= OG, Pq OR re ИЕ n, ne КАУ, : indep. of p. 
HME pë qg" r)\k-r k 


Remarks. The conditional distribution of X given X + Y = k is hyper-geometric. The 
problem can be solved, without calculations, by additive arguments. 


Example 3. Find the Coeff. of correlation in a bivariate hypergeometric distribution. 


N=a+b 
Solution. P(X =x, Y = y, Z= z) = (2) | АЗЫ) w E. 


There are only two independent variables, X and Y, since Z = n – X – Y. Now 
} M). M (M-r). < 

Recall : m (ku) 

-1 
М “(4) (s) (^) o (c 
Wy) 7] = ) 
eworozor = (8) Zee | ape 

BIV. H-G MODEL 


A n" a” pO c? vetri eh БВА SAN 
RONN еа UET 


Now, by repeated use of Hypergeometric Identity : 


A A ERE E, aea a 67:0) 


x-r n-r-s-t 
Consequently, if r+ s +t = m, then 


2 ( 
E px” y? z”) = ie І] a” po c? = a d a? p? c. 


P{X =rlX+Y=k} = 
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EU) = Z = np EY) =” np. _n®ab a” b 
E Eu Mone iue [AT NR 
(2). (ду 
Е[Х?] = — - Жу 0" 0 а(а- 1) па 
| NT IPIS "y 
So Var (X) = E(X?) - E?(x) = 24 (N - n)(N -a) _ np, q.(N - n) 
NW NOE D Wide у 


Similarly, Var (Y) = np,q, (N - n)/ (N -1). 


O xy 


ELLO i 
E(XY) -E(X) EY) = NOR 3 т dod к= wr 


o Pı P2 Р, P2 
Thus, p(X,Y) = — =- =- Ра. 
Sy Py УР: Р 92 41 42 
Note. Compare (2) with §-15-35 (i) for Trinomial Distribution. 


Example 4. An urn contains w white balls and b black balls. Balls are drawn one at a 
time from the urn, without replacement. Find the distribution of the number X of 


draws needed to obtain the kth black ball. Find also E(X""!). (Negative hyper-geom 
distribution). 


Solution. We observe the trivial fact. 


P{kth black ball on the xth darw} = P{(k — 1) black balls in the first (x — 1) draws 
followed by 1, black ball from [b – (x - 1)] black and [w - (x — k)] white balls} 


b w 
f(x) rca gend gs 


x-1 


Expressing the bin-coeffts in terms of factorials and regrouping the factorials to form 
bin-coeffts, we get 


Rx) = ES аман МЕЧ ха К, Ё + 1,... (bw) ...(1) 


By Normality of p.m.f., viz. Дх) = 1, This gives 


N 
x-1\(N-x N = peeked 
JUNE » (4). N= (b & w) 
advancing mth factorial moment is 
EE X Líx-níN-x үз im = у(х +1)...(х+т-1)} 
кер (ШШ | 


уу). 00-125) 
Кел x«k 
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This gives E(X) = 


E^. 


2%. 


38. 


4* 


e Sr (oit 00 мате: (М) Gus 
wn 2 Be PT БАН ett 


z=k+m 
= (k)"! (N+m А) [Change N to N + т, b to b + m in (2)] 
= dini ee AT). | 
„мт CN +m)! Б! 
= (к) ———— — (3 
9 Quem М! v) 
k(N +1) _kk+I(N+1D (N42) KON +1) 


2 E a 
(b+1) ° olm (b 4 2) (b 1) (b+1) ` 


kw(N + 1)(b+1-k) 


V, - 
0 (b +1)? (Ь+ 2) 


Problems with Solutions Provided at the End of the Text 


| | Ti ; "OIN 
A lot of N items contains M defective items. A sample of n items is drawn from 
the lot for quality control. Find the characteristic function of the number of defective 


items, contained in the sample. 
A panel of 7 judges is to decide which of two final contestants A and B will be 
declared the winner; a sample majority of the judges will determine the winner. 
Assume that 4 of the judges will vote for A and the other 3 will vote for B. If we 
randomly select 3 of the judges and seek their verdict, what is the prob. that a 
majority of them will favour A ? 


Let X be H-G (N, M, n). Show that 
Ах; №, М, п) = f(n- x; №, М-М, п) rae) 
= f(M-x;N,M,N-n) (2) 
= fíN -n- M- x; N, N-M,N-n) 1D) 


If X ~ H-G (200, 50; 10) and Y I X = k ~ H-G (190, 50 — k ; 10), show that X + Y - 
H-G (200, 50; 20). 


Exercise 15(b) 


1. (a) An urn contains M red and N — M white balls (M « N). A ball is drawn n times without 
replacement (n € N). Find the prob. of getting x red balls among the л balls drawn. Show that 
the mean of distribution is nM/N [815-22]. 
(b) Show how the hypergeometric distribution arises, by giving an exa 
frequency function of a random variable X following the above law. Derive E( 


а һе 
mple. Obtain t 
x) and Var (X) 
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Show that under certain conditions to be stated, the Binomial 
special cases of the hypergeometric distribution. 


and Poisson distributions are 


2, (a) A receiver contains six transistors, of which two are defective. Three transistors are 
selected at random and inspected. Let X be the number of defectives observed. Show that the 
probability distribution is given by the table (ordered series) : f(0) = 0.2, (1) = 0.6, (2) = 0.2. 
(b) An urn contain w white balls and b black balls, n balls are drawn out at random, (i) with 
replacement, (ii) without replacement. Show that the expected number of white balls in the 
sample is nw/(w 4 b). 

3. There are three cartons of 12 apples each. Two of these cartons contains four rotten apples 
and the remaining one contains three rotten apples. You buy a carton at random and choose 
three apples from it. Let X be the number of rotten apples chosen. Find the probability 
distribution of X. 

4. An urn contains п white and n green balls. We draw balls successively and without replacement 

| one after another until all the 2л balls are drawn out. Find the chance that in any stage of the 
J trial, the same number of white and green balls has been drawn. 

— 5. Insampling a lot of 100 items, the sampling plan calls for inspection of 20 pieces. If there are 
Ж = any bad pieces we reject the lot, otherwise we accept it. Find the probability of accepting a 
lot with 5 defectives, if we allow 1 defective in the sample. 


Establish the following recurrence relations : [Vide Example 15-5] 


LM S DN M = c 


f(x; М№ММ +1, п) = (Na МУМУ f(x; №, М, п) 

з TH 
f(x; №, М,п+1) = трут тиа f(x; №, М, п) 
ENTIS ОЕША ni М) Ж. м, п), 


(М+1-п- М + х) (N+!) 

.7. Suppose that 100 cards marked 1, 2, ..., 100 are randomly arranged in a line. Show that the 

number of even integers in the first 20 positions is hypergeometrically distributed with 

.. parameters № = 100, M = 50, n = 20. 

3 Six cards are drawn without replacement from an ordinary pack. Find the joint density of the 

-number of aces X and the number of Queens Y. Show that the conditional density of X, given Y is 
NC О eC. O0Sx*ys6 0<ху<4. 

M Show that, as n, №, M — œ such that (n/N) > 0, n(M/N) —> m, the H-G distribution tends 

4 to Pois (m). 

| The k-dim H-G distribution has the p.m.f. 


| N, Мр, | /(N 
fo... x,) = Р(Х, = x), (X, | "Jui Пе, 


| er MED re x, >0, p> 0. 


Show that EAK, | А te |} has H-G distribution. 


Et 
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MULTINOMIAL DISTRIBUTION 


15-30. Definition 
A random vector X = (Х|, X» ..., Xj) possessing the probability law 


fx, Ey oi itt | : D pP s pi 0 <p <1, V i; f(x)=0, otherwise 


Me, dires dA 


where x, +x, +... +X, =N, p,*pj*..*p,-7]lis called a multinomial (vector) variate 
The distribution (1) is called the multinomial distribution. We often write “X is multin 
(n, p)", 1 <i € k to indicate that (Х|, X,, ..., X,) has the probability law (1). The constants 
n, Dy. Pa ..., p, are known as the parameters of multinomial distribution. A random 
vector X obeying law (1) is written X ~ Multin (n ; k, р) or X ~ M (n ; k, pj. 
Comment. We may write (1) as a function of k – 1 variables by substituting 
X,7n—-x(,—X4,—..— X, ү. Thus 


n p? AX +. Т. " 
JO. £5, ЖУ Хы c audiri НЬ гуд 262) 
However, it is convenient to retain опе redundant variables in order to preserve the symmetry. 


Physical Conditions for the Occurrence of Multi-nomial Distribution 
The trials with the following properties lead to the multinomial distribution : 

1. The result of each trial can be classified into one of k disjoint categories, €. ..., C, (say). 
2. Outcomes of successive trials are independent of all other trials. 

3. The prob. of element x є C, is p, and is the same constant for the same category for 
each trial. 

4. The series of trials is performed a fixed number of times. 


15-31. Multinomial Distribution 
bet M TTE S be exhaustively disjoint events associated with a random experiment 
such that P(A;] = Pp Py + P2 + -t Px = 1. If the experiment is repeated л times, the 
probabilities that A, occurs r; times, A, occurs r, times, ..., A, occurs r, times is given by 

n! 


UMEN T A. рү P? PE 


RAN 


where r,*5-..*r =n, OSpj Sh p *pyt..*p,-l 


Proof. The r, trials in which A, occurs can be chosen in (") ways. The remaining (л - " ) 


trials аге in store for other events. Тһе r, trials in which A, occurs сап be chosen in 


n — ү ula и А А п=ђ = 
| А } ways. Similarly, the r, trials in which A, occurs can be chosen in | ; | 
P 3 


ways and so on. Consequently, the number of ways in which events A}, A), -=> A, can 
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pen is, by sequential counting, о маа 


hapt 


А m 
b n n — г, n —r — Р. n-r — з 
d «ў (4 : Y Ha n -r,-.. v. n! 
p З А J| (059... 0,1) 
к= апу one of these ways in which events Ai, A, ..., A, occur. Since the л 
s are independent, so must be trials mesh, TT 


"m occurs 7, times, A, occurs r, times, „ А occurs r, times} 
его, occurs r, times) PA, occurs r, — . P(A, occurs r, times) 


| (p? A) dp. 


1 the ways in which these events happen are disjoint, 


“Р, Osta ote) = Np)" (py)? .. (p, 


d M train 
( 7 (6969-09 7? 09 «0D. 
For a Trinomial distribution 


E. n! Xj [Nod 3X4 n dil da x 
PO xx) = "memi ү бы (Аун Гэ Р РУ 


BX +X, +x, =п,0<р<1,р+р,+ру=1. 
2. М .С.Е of Multinomial Distribution 
M( tb-t) = (p e" + pe” tak pe)" [8 8-16 (6)] x0) 


ginal Distributions of Multinomial Law : 
m f. of X, put t, 20, (ў + Dy 5pm L2, 1.4 then 
Å 


маг) = My... 0,1, 0,..0) = (p; e" + Хр)" = (ре! +1- р)". 
К X) -(««neY. 1-р NT 


in (n, р), i.e. each marginal (individual) variate is binomial. 


disi ribution of (X, X,n- X, - X) is again multin(n; p, pj,1- p, = pj 
м 0 hut) = Efexp[tX, +X, +t, (n X, - X,)).li = 1,j = 2, for simplicity] 
Borm ye yan g^ (s ht^ epe "+ pytut p)". [by (D) 

is Oppel Е 63) 


Р aiey н у wo А -— p 
Eoria VENE giü-a-mt ol 
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3. Conditional Distribution in Trinomial Law : {X, 1X, =v} ~ bin [n – v, p, / (1 р,)) 
Proof. P(X, =ulX,=v} = P{X, =u, X, = v}/ PIX; = v) (by Def.) 
= P{X, =u, X, =v,n- X-X, =n-u-v}/ P(X, =v} 


n! v n-utv 
p; (1-р — Pr) [by (3)] 


Numerator 


u 
иу (пиу) 


^ n! " EX 
Denominator = ae wie (1- p)" ", [X, ~ bin (n, p;)]. 


PX =ulX, aya uut (1-72 | eue 
2 2 


15-33. Sum of Individual Components of Multinomial Distribution 
M(t:X,* Xj) ЕДИН) M(0,...,0,6,0,0, t, 0,...,. 0), (t, — t, =!) 
БРИ pe ep. ta. p нр үн. + p)" 
= [I-p,- pj + (Pp, + p)el-(q* pe), [p=p, + P.a471- pl 
This shows that (X, + X;) - bin (n, p; + p;). 
Note. (X; + X; + X,) ~ bin (n, p; * pj; * р), і j*k and so on. 
15-34. Correlation Coefficient 
Since X, is bin (n, pj), we have Var (Х,) = np, q;. 
Since X, + X; is bin (n, p; + р), Var (X; + X) = n(p, + терер). 
Var (X; + X) = Маг(Х,) + Var (X;) * 2Cov (X,, X;) 
2 Cov (X, X) = [n(p; + pj) - r(p; + pj) ]-- np, q; -np;q; =- 2np, р, 


ye. 


p(X;,X;) = 0;/0j0; = — [р; р;!4:9; [independent of 7] К) 


Note : 1. M(t,,t;) = МОО, ...,0,1,, 0, ...0,1,,0,..., 0) = (ре" +P; e” +p, tp). 


д? M(t;, t;) ttt; " 5 n-2 
Mikae e Tul -n(n-l)pp,le' '(p,e' + pe^ * p +...+ р) 1-0 
-n(n-l)p;p,  (*j. 
Cov (X, X) = E(X; X;) - E(X) E(X;) = n(n - 1) p; p; — n^ p; pj = — np, pj. 
2. Observe that S, = X, +... + X, = total sum = Const. is degenerate, since Var (const) = 2 


0 = Var(X, +...+ X,) * Var (X,)+...+ Var (X,). [Х; are dependent] 
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15-35. Reproductive Property 


fX- Multin (л; p;) and Y ~ Multin (n р) 1<і<к 
then KY is Multin (m + n T 


proof: Since X and Y are independent k- -component random variables 


‚ are independent random vectors, 


M(t:X*Y) = M(t: X).M(t:Y)=(Zp, e)" (Ур, ен)" = (p, e^)"*". 
Thus X + Y ~ Multin (m + n, p), 1 < i € k, by uniqueness theorem of m.g.f.'s. 
Remark. This property characterizes the multinomial distribution. 
15-36. Worked-out Problems 
Example 1. The trinomial distribution of two variates X, Y is defined by 


! 


| cae REA i 


a n 


EE, 1,...., and + y <n, did ss 451, p*g&Xl. 

(i) Find the p.g.f. of X, Y, Z, [Z2 n- X - Y]. 

(ii) Show that Var (X + Y + Z) # Var (X + Y + 7). 

(iii) Find у, (х), fy), fy y (к | y), E(X I Y) and Corr (X, Y). 

Solution. (i) We rewrite: p = ру, q = Pa, 1 - P - q = P} n — x — y = z, so that 


En 55) = > ae EA". p P3 th hh = 2 (enr (р) (55). 


‚ Gt, tt) = Е@ d 12) = (р + pt; + pt). [By Multinomial Expansion] 
(ii) Since X + Y + Z =n (fixed), Var (Const) = 0, so 


* 0 = Var (X + Y + Z) + Var (X) + Var (Y) + Var (Z), > X+ Y + Z is degenerate. 
To get rid of redundant variate Z, we put t, = 1 and the p.g.f. of X and Y is thus 


G(t,,t,) = [pt * qt; + (1 -p-q)s G(t,t,l) (1) 
(ii) G(t,1,1) =[(—p)+pt]" X ~ bin (n, р). 

КЕТО аа]. => ¥ ~ bin (mg). 
Noting G(e' :1) = M(t: X) provides M(t, t,) +M(t,) M(t,), so X and Y are not independent. 


* чы, RE s ВА pero. (n — y)! у! | 
а fy) -| xtyl(n—x — у)! n!q' (1-2 4)" 


x n-X-y 
ae ee 1-25) х= 0,1,2,....п- Y. 
ew 1-4 1-4 


Th, (уу-у) .bin[n-y,p/Q0- Ql 0«p/0- 5t 
Similarly, (Х\Ү=х) = - bin[n— x, q/(1 — p)]. It follows that 


№. E(XIy) = (п у)р/ (1-4) EY 1x) = (n - х)4/(1- Р) (2) 
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2 
fo = n(n - 1) pg[p.1+q4.1+(- p- D = n(n — 1) pq. 


Cov (X, Y) = E(XY) - E(X) E(Y) = (n^ pq — npq) — (np) (nq) = — пра. 


Now : E(XY) = 


/2 
[e] —npq Pq 
Eom +& E | | " 

PLY) "S o, Jnpü-p.nqüd-o |0@-ю(1-ф P 

Note. From the known properties of linear regression coefficients, using (2) 
p? = (Coeff. of х) (Coeff. of у) = р4/(1 – Р) (1 - 4). 

Thus p is given by (p « 0) since regression coefficients are negative. 
Example 2. A trial can result into one of three possible outcomes А, A,, A, with 
probability p,, P» ру; ру + р; + Рз = 1. This trial is performed n independent times and 
outcomes A, occurs X, times (j = 1, 2, 3). Determine the conditional expectation of X, 
given X, = m. 


Solution. For X, = k, X, = m, we automatically get X,-2n-m – К. Hence 
P(X =, X,-m) _ P{X, =k, X, =m, X,=n-m-k} 
PX ST P, =m) 


ntpi.pr.pi ^ n! у AA | 
por min-m) ^ qi" ІХ, - bin( р) 
k n-m-k 
Vm |а) (& а-а-а.) 
(n—m—k)!k!\q d; d; 4) q 


M 


This shows that (X, = K1X, = т) ~ bin (n — m, p, / q;) 


P(X, = КІХ, = m) 


This provides : E(X, |X, = m) = (л m) Cp, / 4). (45 =1= p,) 


Example З. Independent variates X, 1 <i < п are Poisson with parameters 7, 1<isk. 
Let S = X, + X, +... + X. Prove that the conditional distribution P(X,, Хз, ..., X,1S=nh 
is multinomial. 

Solution. Recalling the reproductive property of the Poisson variates, we have 
S ~ pois (УА). Now 


р = PX, X, os X 1S =m) = PIX, mr Xp mes Xp n7 son PSH) 


P(X =)... Р(Х, 97, 4). P(X, 2 n7 n 1 4)! PS = nn) pou, are indep 


» " =А 4 k-i - a E 
Chu AA E ы АМ ы ЗУ 
n! ry! (п-п ш МЕ. mn 


n! hoi i E 
ee nont T n dk. arv 
ТАТ TA NS T 


[A = ХА. ] 


Obviously Èr; = 7, Ур, = 1. We have established that- 
(X, ПХ, ...ПХ,)ІХ X; =n is multin (л; Puy Po enw Pps 
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Remarks. If X. = т, V i, then p, = 1/k, so that probability in multinomial set is 1/k (constant). 


1*. 


2*. 


5". 


4*. 


м 


Problems with Solutions Provided at the End of the Text 


Three fair dice are cast. In 10 independent casts, let X be the number of times all 
three faces are alike and Y be the number of times only two faces are alike. Find 


the joint p.d.f. of X and Y and compute E (24 XY). 


For a Trinomial distribution [§15-36, Example 1] find the m.g.f. of the variate 
2 = п - X - Y. Hence or otherwise find Var (Z) and Cov (Y, Z). 


Prove that the multinomial distribution (815-31) can be approximated by the 
multi-dimensional Poisson law : 


Tete ore v dev an M NOU TR TR 
Р + are small and п is large but np, = A, fixed. 


Show that the k x k covariance matrix of a M(n ; Pi, p», ..., p,) distribution is 
singular with rank k — 1. 

Of the 100 people in a certain village 50 always tell the truth, 30 always lie and 20 
always refuse to answer. A single unbiased die is tossed. If the result is 1, 2, 3 or 4, 
(event A) a sample of size 30 is taken with replacement. If the result is 5 or 6 (event 
B) a sample of size 30 is taken without replacement. Find E(X) when X is defined by 


X = 1, if resulting sample contains 10 people of each category. 
X = 2, if the sample is taken with replacement and contains 12 liars; X = 3, otherwise. 


Exercise 15(c) 


(a) Team A is going to play five games with team B. It is known that team A wins any match 
with team B with probability 0.5, while team B wins with probability 0.3 [with the remaining 
games being tied]. What is the probability that team A will win two games and lose one ? 
Consider successive games independent. 

(b) Assume that team A can beat team B with probability 0.4 while team B will defeat team 
A with probability 0.3 and three is also some chance of a tie. What is the probability that 
team A will win a play-off series consisting of four games ? 

(a) Two dice are cast 10 times. Let X be the number of times no 15 appear and let Y be the 
number of times two 1s appear. Find P(X «3, Y «3, P(X * Y24J andP (2X X * Y &4]. 

(b) A die is cast 12 times. Find the chance that every face turns up twice. If X and Y 
denote the frequency of turning up of 5 and 6, find the joint distribution of X, Y and show that 

Cov (X, Y) 2 -1/3. 

A and B play 12 games of chess of which 6 are won by A, 4 by B and the remaining games 


being tied. In a tournament of 3 games, find the probability (i) A wins 3 games (ii) B wins at 
least one game. 


* (a) A box contains 5 red, 4 white and 3 black balls. A ball is selected at random from the box, 


its colour noted and then the ball is replaced. Find the chance that out of 6 balls selected in 
this manner, 3 are white, 2 are red and 1 is black. 


480 
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11. 


12. 
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(b) A box contains equal number of white, blue, yellow and pink dM E. are drawn 
independently and with replacement. Find the probability that exactly k, (1 < k <4) colour. 
will appear in the sample. 
A group consists of 50% Indians, 30% Ame 
selected at random, find the chance that 2 are Indians, 
(a) Three coins are tossed n times. Let X, Y, Z denote respectively the number of times no 
head, 1 head, 2 head appear. Find the joint density ft У, z) as well as fix, z | y). 
(b) Two events A and B associated with an experiment, have respectively probabilities of 
occurrence p and p,. Show that in n trials, the probability that AB occurs r, times ; AB’ : r, 
times ; A’ B : r, times, A’ B' : r, times 15 


(nn! In in. p^ pp р)" ^ Pi) 


Show that the mode (most probable value) of the multin (n, k, pj is given by xy, X» ..., д, 
satisfying np,- 1 « x, &(n* k- 1) рьі= 1,2, k. 


Suppose (Y,, У, Y3, Y4, Ys) is multinomially distributed with parameters n, р, p». Рз, Pa Ps. 


ricans and 2096 Britishers. If a sample of 6 persons js 
3 are Americans and 1 is a Britisher. 


№ +74 


What is the distribution of (Y, + Y}, Yj, Y, + Ү,). 
Suppose (Ү,, Y), Y;) is multin (n; ру, p», pi). Show that the conditional distribution of У, 
given that Y, + Y, = г, is bin [r, р, / (p, р]. 
Let (Y, Y), Y; Y4) be multin (л, p, р, рз, рд). Prove that the conditional distribution of 
(Y, Y2- Y;) given Y= k is multin [n — k, p,/(1 — рц), р›/(1 — ра), p3K1 — p4)l. 
If X = (Х|, Х,,..., X,) is multin (л, ру, p», ..., Pk) find E(Y) and Var (Y), where 

FSSC np Pipa S002. í 
A chain smoker has (n + 1) match boxes B,, ..., B, , , each containing N matches. Any time he 
lights a cigarette, he chooses one of the boxes at random. Let X p 5 X, be the numbers of 


matches left in the remaining n boxes. Find the chance when (i) a box is found empty for the 
first time (ii) Any box is emptied first. 


Suppose that B,, (1 < k < п) is chosen with prob. p,. Find the chance that B, empties first. 
Note. The case n — 1 is called Banach match-box problem. 


15-40. Logarithmic Distribution 


Since, - in (1 = q) = X(q'/x), 1 € x < ©, we multiply it by (— -l to obtain 
(— ln ру! X(q'/x) = 1, which motivates. y it by (- (n p) to 


Definition. A r.v. X is said to possess logarithmic distribution with parameter p, if its р.т.Ё is 


P{X=x}= f(x)-Lq' 1х, L = (-ln р)! ed... T 


15-41. Moment Generating Function and Moments 


M(t: X) = E(e*) = LX(e"q* 1x) = LE (qe?) х= -Lln(1- qe), x22. 0 


Assuming | ge’ | < 1, we expand (3) to get 


M(t:X) = LY - т TH da ps (3) 


$15-42. Decreasing Factorial Moments 48 1 


M = EX HL Ye r7. ng 
24 P. Жей, 2, 3, (4) 


ET LEq -l4!(0 -q)- I4! p, EQ?) - L3d'r- Lal (V - ay! = Lq! р? 
) = LEq'r - Lq(1* 9)! (0 - 9 = Lq(14 q)/ р. 

E = LEq'r' 2 LDq^ +4(1+4)?]/(1-4)* = 14[24 + ( +4)?]/ pt. 

41р = (4! р) = (141 p)(1- Lq]. 

Bop = 3(Lq/ p^) .(L41 p) +2(Lq/ p = La {4 + (1 - La) ( - 2L4)}/ p’. 
‚” 3 

= p4- App 685 pi’ = Зщ“ 

ED шо узад ах georg -an2n 

= Шр 41+ 49+42 – 414 – А14? +614? – 3124). 

= SBi = pa 1 (7 = (gy Q1 - Lg) (4+ (0 - La) Q - 214). 

EL os {1+ 4q+q° - ALq - ALq^ + 6L q^ – 3L'q*}(Lq) 


"а "ч б 


asi g Factorial Moments 


m OL Ly ignc. Lq' Y мы g^ 


M -1(®—)! x we = ДЫ 


D! gsp Dg. Y ie ! 4 ar -r=4] 


| же T 25 vd : узо k 


E i£ - 


Ч" "= Lgl pY ire THO + | pen яі Ë eure 


ah eo xe. din 
Vio Eix -D= el p > E(x?) - 14! p^. 
E ug nein $n 
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А k 
x+k—-1) pq. (x*k-D!| p SP 
лод = | k-1 VR la о кыла lai den 


We now let k — 0 and use L’Hospital rule, to get from (3) 


k — 
lion kp -| - lim Ip Bear: = limf as 
k>0\ 1] — p k—0 =p tnp k—0 in P in P 


lim fo(x) = (-Inp)q'/x x=1,2,3.... ...(4) 


The limiting density is the same as that given by (2), with a = q. Thus, the truncated 
Neg-bin distribution reduces to 0n-series distribution, when the parameter k — 0. 


15-50. Generalized Power Series Distribution (GPSD) 
Let X be a non-negative integer-valued r.v. with generating function 
ЯШ) Xa Bi s0.52:52-70, 5:0. Жу, 
so that O < 2(0) < o. We assume that (1) is uniformly convergent. 
Definition. A r.v. X is said to possess GPSD if its p.m.f. is 


а, Өе  g(Be') 


M(t: = Е MS = ` 
ee D жешс 


15-51. Special Cases 

The definition (2) embodies several discrete distribution, e.g. Binomial, Poisson, 
Negative Bin; n-series distribution, etc. We illustrate by some derivations. This shall 
also point out the method of attack. 


1. Binomial distribution. Let g(0) = (1 + 0)" with 0 = p/q. 
Then g(0) = Ха, Ө" provides (1-0) -Z"C,0'2Xa,0 => а= "C,. 


e Д Quern 


2. Poisson distribution. Let g(0) = e’. Then e? = УЮ" /x!= Ya, 0” => а =1/x! 
Дх) = Oe 8 / x! 0sx«o. 
3. у Mepis distribution. Let g(0) = (1 – 9) * , With Ө = g, 
Then g(0) = 24,0" — Фф е = za B ia (e n. id 4 d. 
4. Log-Series distribution. Let g(0) = — ùn (1 - Ө), умі 
Уа,0* = -01(1-0) => а, =1/x, hence f(x) = 6* / x[-àn (1-0)], 1«0 «0. 


h ! 


1 


"e | 
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, А \ E 
g9, Cumulant Recurrence Formula 


КЙ = Un №), we get from 15-50(3) K(r) = (n 5(0е') — (п (Ө). 


mu 


ad (f) by its defining series ; differentiate it partially w.r.t. parameters Ө and t to get 


1 ОК ege) g(0) . r-' Өе (е!) 
EU E" 094) z9' (-D' £008) 
ng g'(0e') provides 


che 


ER ee £92") 
rae ^ "rl Qe 


Ok -0g0)/g0) k,, -0(dk/a). 
| -series distribution with p.d.f. 
= -q (xin р), x-.2,..,,0«p«1;qzl-p 
PYM (5) Ma = (ди, 0g) + ria Hea 
Ж (d) kí = 0k, 108), 


„ MM Y \ 


р 


| sas n 


people who don't count wont count. (Anatole France) 


Normal (Gaussian) 


Distribution 


16-00. A Special Form of a Function 


Е 1 = oo -A(az*) 
Consider [ „е 


-00 


ах. Put (x - p)/o = z, then 


— 
Ш 


© -12 7 о -17 t: ay] 1-1 1 б. _ 
g E“ dz-2o[, e? apr MM dt (2: =r) 


V20 .Г(1)=с 2n. 


1 
2x0 


Definition. А r.v. X is said to possess Normal (or Gaussian) distribution, with parameters 
и and o°, notated N(p, o^) if its p.d.f. is 


2 
" Aes | 
Conclusion : |, e C) dx = 1. Thus, we introduce : 


2 
f(x) = 1 Уз Eee) =< « d. silks 
o 


oVJ2n су27 


x = (р - ko) 2= 0 х= р+ Кс 
Warning. Some authors write N(u, с) instead of N(p, o^). We shall insist on N(p, o^). 
Distribution Function : Ф(х) = Р(Х<х)= o» f(x) dx ...(2) 
Р{а<Х<Ь} = @(b) - da) = |? f(x) dx. (3) 


р» integral in (2) cannot be evaluated by elementary techniques. Its Tabulation is 
Provided at the end of this book. 
*ample 1. Two r v.s with the same distribution function may not be identical. Can 
апі -X have the same distribution ? If so, when ? 
ion. Let X ~ N (0, 1) and take Y = —X. Then | 
PW s y) = P(-X < y) = P(X z - у) = (X € у), by symmetry. [Draw a figure.] 
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Example 2. If f(x) = Ces" * оо < х < о, evaluate C, p, с?. 
Solution. Here f(x) = Се?) = Ce! exp [-(x - 1) /2 (1/6)]. [Gaussian Form] 
Compare it with f(x) = (cJ2n)'! exp[-(x - u)? 1262], to gety = 1, c^ = 1/6, С = (3/ ne^) 


16-12. Standardized (or normalized) Normal Variate 
Setting z = (x — p)/o, reduces N(y, o?) to N(O, 1) which is called standard (or unit) 
normal distribution. The c.d.f. of N(0, 1) is thus 


M(z) = P(Z <2)= f$, f(2) dz, f= a м] "i 


d(z) has been thoroughly tabulated. We also frequently use 


w(k) = f f(z) dz - 4k) - 0.5 (2) 


Q(k) = f° f dz» f; fe) dz=0.5+ yk). BEN 


Standard Valuations. (1) = 0.3413, y(2) = 0.4772, y(3) = 0.4987 
w(1.96) = 0.4750, (2.58) = 0.4951, (1.645) = 0.4500. 


16-20. Tabulation of Normal Distribution 


P(a«X xb) = ['fGodx- |} о) а ft о) lf P" - рет" | rods s- 21 

= w[(b—p)/o] - уа j)/6] where f(z) = (42x)! е. [p.d.f.of N(0, 0) 
We thus notice that the evaluation of P{a x X < b} is related to the integral y(k) which 
represents area bounded by the curve y = f(z) and the ordinates z = 0 and z = k. The 
definite integral w(k), also called normal probability integral, cannot be evaluated by 
elementary techniques and has been tabulated numerically for different values of К а! 
intervals of 0.01. 


Another table related to the ordinates of standard normal curve у = (42x) ! ехр(-12' ) 
is also presented in the Appendix. | 
16-21. Special Limits 
Let X ~ N (p, o?) put z = (x - p)/o ie. x= p+ oz ; then 

P{p -ko < X < p + ko} = P{-k < Z < k} = 2y(k). 


y 
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Using tables of N(0, 1)-area we obtain j atk Ok 

[1212 1) = 24001) = 0.0826 ; P { 1Z1 <2) = 2w(2) = 0.9544 ; P{ 1Z1< 3} = 2y(3) = 0.9974; 
pi izis 1.96} = 2y (1.96) = 0.9500 ; P { I ZI < 2.58) = 2y(2.58) = 0.9902. 

From above, we infer that area under the standard normal curve N(O, 1) and bounded 


by the lines z = € 1.96 is 95%. This means that the area beyond the ordinates z = + 1.96 
is 0.05 (i.e. 5%). Because of symmetry, there is 2.5% area in either tale. 


We further infer that area under the standard normal curve N(0, 1) and bounded by the 
ordinates z = £2.58 is 99.02% which may be roughly treated as 99%. Thus limits 


;222.58 exclude 1% area (196 in each tail) in N(0, 1) curve. 


Observations. Almost all z-values lie between р + Зс which are called three-sigma limits. 


16-22. One-tailed Area 

To find limits which set aside particular areas in one tail, we use inverse reading from 
the area-table of №(0, 1). Thus, the probability 0.05 in the right tail corresponds to 
2= 1.645 and the probability 0.01 (area) in the right tail corresponds to z = 2.326. 


16-23. Some Standard Terms 
1. A Statistical Hypothesis (notated : H) is a statement about the nature of a universe 
or population. It is frequently stated in terms of a population parameter/s. 
2. The Null Hypothesis (notated : Hj) is a statement about a population parameter 
which is to be tested. Thus H, is an H we need to test. 
3. A Test Statistic (notated : TS) is a function of the data related to a sample. The 
value of TS, under H) written (TS), helps reject or accept H,. Generally, TS is a 
standardized variate. 
4. Critical Regions. The set of points on the z-axis which constitute the tails may be 
denoted by C and is called critical region or region of rejection. Obviously, C = (Values 
of TS for which H, is rejected] 
5. Level of Significance. The size (area) of the critical region is called a level of 
Significance and is denoted by a. Obviously, о is the maximal probability of rejecting 
Н, when Н, is true. The most frequently used levels are а = 0.05 (5%) and a = 0.01 
(1%). The critical regions at а = 0.05 are 

C= {Z:1|z12 1.96} for 2-tailed (both-sides) regions. 

C = {Z : z 2 1.645}, for 1-tailed (right-side) region. 
The Critical regions at а = 0.01 (1%) are 

C = {Z : |z | 2 2.58} for 2-tailed (both-sides) regions. 

C = {Z : z 2 2.326), for 1-tailed (right-tailed) region. 
E summarize some of the frequently used critical values (See Fig. p. 486) 
Piz ч 1.96 1.65 1.28 0.126 0.062 

EE) s. 0.05 0.10 0.20 0.90 0.95 
Convention, a = P(Z2z,): Area beyond (i.e. in front of) Z = z, in №0, 1) curve. 
* The smallest significance level at which Н, is rejected is called p-value. 
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16-24. Worked-out Numericals kml N(0, Dsubulations 

Example 1. If Y — log,g X is N(4, д» ) and Іор, 1202 = 3.08, log,, 8318 = 3.92, find 
P{1.202 < X < 83180000}. 

Solution. р = P(1202« X «8318x 10^) = P{log 1.202 < log X «log 8318 + 4} 

P(0.8 < Y « 792) = P(-196 < (Y - 4)/2«196], [Y ~ N(4, 4)] 

= P(-196 < Z «196) = 0.9500. [by Standardization Z = (Y ~ 4)/2] 


Example 2. Let X ~ N(y, o^), and dX) be the c.d.f. of N(0, 1). 
(a) If o = ру > 0), express P(X < - pl X < u} in terms of dXX). 
(b) If o^ = А(џ), и > 0, find the function А such that P(X < 0) does not depend on y. 


Solution. (а) p = P{X <-plX<p}=P(Z<-21Z<0}, [Z=(X-p)/ote. Х=р+с1] 
P(Z <—2}/ P{Z <0} = 2@(-2) Po P(Z&0)-1/2] 


(b) Let H(p) = P(X < 0) = P(Z<-p/ VR) = [7^ f(z)dz "WS 
where f(z) = (1/ V27) exp (22? ) is independent of p. Now H(p) shall be independent of 


р, if the upper limit in (1) is independent of p, which requires u/A/h = const. = к? 

say. This gives А = kp’. Thus, with the choice h(u) = kp’. P(X < 0) does not depend on u. 

Example 3. Let X ~ N(p, o’). Show that the maximum of P(c — h < X € c +h} occurs at 

c= p, A 0. 

Solution. We note that, Z = (X — p)/o is N(0, 1), so that 
| 7 + Z e 


f(z) = ие í il Dees 


р(с) = Plc-heX сън Р{ 8 „Хн суни] 
o Oo с 


cth- c-h- 
s Au = (E [F; is c.d.f. of Z] 


111 


l 
|— 
ʻ 
po 
e 
BE 
= 
| 
T 
MCA, 
| 


р'(с) = 
р"(с) pen 4p (Stew) (еви) 

[e] 
= „єс + +h- к}, (с-һ- a tn [by (1) 


с o? 


р'(с) = 0 = (c+h-py =(c-h-py > c=p 


p'(p) = De t GE f Bal <0. 


Hence at € = u, p(c) is maximum. 
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Comments. This proves that (X = u} is the modal point of Мү, o^). 


1*. 


2*. 


3*. 


4*. 


5*, 


^ 


- Show that the constant C can be selected so that f(x) = Ce 


Problems with Solutions Provided at the End of the Text 
If X ~ N(30, 5°) and Y ~ N(15, 10°), show that 
P{26 < X < 40} = Р{7 < У < 35}. 
Show that the probability that the number of heads in 2000 throws with a fair 


coin lies between 900 and 1000 is approximately 2F(245)—1, where F(z) is 
the c.d.f. of МОО, 1). 


If X is N(30, 5^, find the probability of 
(a) 26 < X < 40, iy X = 3045 5, (c) X 2 42, (d) P(X < 28). 


Student's final score is the value from М№(р, с>) and instructor's grading is as 


under : Grade A when score exceeds u + с, grade В when score falls between p 
and p + o, grade C if score falls between p — o and р, grade D if score falls 
between p — 20 and p – с and score F if score falls below p – 2c. Calculate 
probability of each grade. 


If X is N(50, 10?) find P(Y < 3137) where Y = Х? + 1, given that 
w(0.6) = (2ny' f^ (e? 202258. 
If X is N(1, 4) find the values of 
p, = P(IX-21«11X50], p; = PIX «01 1X - 1175) 


If X is N(p, o?) for an interval of length т > 0, for what value of x is the probability 
P(x € X € x * 1) a maximum ? 


Exercise 16(a) 


. Let X be a normal variate with p.d.f. 


f(x) = 0.03989 exp [-0.005 х2+ 0.5 х 12.5], -0<х<% 
Express f(x) in the standard form and hence ог otherwise find the mean and Var X. 
[Ans. р = 50, o^ = 100] 


. Find the mean and S.D. of a p.d.f. f(x) = Ce V 6*9, co < x < oo where C is constant. 


(Ans. p= 3, 07= 12, C2 247) ^] 


NM Ta И : 
. Determine the constant C so that f(x) = Ce os" , =о0 < x < 0, satisfies the conditions of being 


2 A -8 -1/2 
a p.d.f. Obtain the values of p and 0°. [Ans.u 28,0224, C» e (85) |] 


-(9x! -12x+ 13). оо < x < oo is the p.d.f. 
2. a 9 
of Normal variate. Find also the values of н and o^. [Ans. р = 2/4, 0 = 1/18, C= 3e | т. 


х? isfi itions 
Show that a constant k can be selected so that f(x) = k2™ en < x « оо, satisfies the condit 


of a normal p.d.f. Find also the values of proper р and с. 
Р [Ans. и = 0,02 = (2 in 2y, k= (ln 2/2)". 
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6. If X is N(O, 1), show that for all x > 0 
(a) Ф(-х) = 1- Ф(х); (b Р{-х<Х < х) = 2Ф(х) – 1 
(с) Р(Х – ц1< 4} 2 2Ф (К/с) – 1; (d) P(IXI > х} = 21 - Ф(х)] = 26 (-x). 
7. (a) If Xis №2, 1), find P{|X-21< 1). 
(b) If Xis №2, 2), express P(1X- 11< 2) in terms of N(0, cat. 
[Ans. 0.6826, F(2 ^) + F(3/ 42) - 1] 
8. Let X ~ N(0, 1), Y ~ №2, 4) and Z ~ N(-1, 1) be independent. Compute the probability that 
exactly two of these three variates are less than zero. [Ans. 0.4328] 
9. Let X be N(12, 42). Find the probabilities 
(i) P(X 220), (ii) P(X < 20) (iii) P(X < 121X z 0). 
Find the constants a, b, c when P(a < X < b) = 0.5, P(X < a) = 0.25, P(X » c) 2 0.24. 
[Ans. 0.0228, 0.9772, 0.5; а = 9.3, = 14.7, c = 14.8] 
10. If Xis N(75, 25), find P(X» 801 X» 77). [Ans. 0.46] 
11. If X ~ N(10, ?) and P(X > 12) = 0.1587 show that P{9 < X € 11} = 0.3830, use (1) = 0.8413, 
Ф(– 7) == (0.3083) 
12. If X is №11, 2.25), find the number К such that 
(a) P(X>k)=0.3 (b) P(X>k)=0.09. [Ans. 11.79, 13.01] 
13. If X ~ №5, 16) and Y ~ №4, 1) find k such that 
(a) P(X «k) = 0.919 (b) P(1Y-41» к) 20.012. [Ans. 10.6, 2.51] 
14. If (n X ~ N(1, 4) and łn, 2 = 0.693, find P( 1/2 < X <2}. [Ans. 0.2427] 
15 


17, 


18. 
19. 


20. 


. If X is N(O, 1), use Chebyshev’s inequality to estimate P( | X | > 1.96). [Ans. 0.26 (crude)] 
. Let X ~ Му, 0°). 


(a) If P(X < 89) = 0.90, P(X < 94) = 0.95, find p and с>. 
(b) Ifc 22 and Р(Х < 3) = 0.8, find p. 
(c) If p 2 0 and P( 1X 1> 8) 2 03, find c. 
(d) If P{(4X —3)>0} = P((4 - 3X) 0) =0.9, find p and c. 
(е) If P(IX-yul2zc) = Р{1Х-рі<с}, с> 0; бпа с. 
(f) Ifo=10, P(X < 80.5) = 0.3264, find p. 

[Ans. (а) 72.46 and (13.7)^, (b) 1.32, (c) 5.7, (d) 1.04, 0.227, (e) 0.675 c, (f) 76] 
(а) YF X ~ МІ, 1), find P((X - X°) > 0). (b) If X ~ Лр, u?/9), find P(X « 0). 

[Ans. 0.3413, 0.0013] 

If X ~ N (5, 10) find P(0.04) < (X — 5)? < 38.4 Hy [Ans. 0.90] 
A normal distribution has mean 77. Find its S.D. If 20% of the area under the curve lies to the 
right of 90. [Ans. 15.5] 


Show that the p.d.f. f(x, и) = (2ли) 1/2 exp (=x? / 2u) , =% < x < oo, of a N(O, u) variate satisfies 


the heat equation (0f / Ou) = 1 (0? f/x”). 
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-(x - n) 20? 


¢.30. Some Standard Properties for f(x) = жр е 


,—90« Xx «o0 
4, Mean (absolute) Deviation M.(a).D. 


y M denotes the mean deviation of X ids и, then using definition 


=x- u)? /в? 


! eee Izle ^ dz ы 


E25 m -i- [2 \ 

á — - d э» = 

k. т i. ze 2-6 "a [Even integrand] 
D. o42/n 2(4/5)9. 


„Mean deviation of order г : 


M, = E(IX- р) = | fe)Ix- ul dx Put S 1 
= T UM tele Fae (Integrand is even) 


r r r/2 rl 
pueros т. {Шерт ты 


= J2n 0 Jn 
^ Exe 
b : Ут : | 
і s | 
2r 5r 
Б. c?" 2 2r +1 
E м EF 1 ) 
| M, I, Jn 2 


iartile Deviation : 


Maiy -1212 Кә t 
d © f(x)dx = 025 e |, gees =0.25, where z= ——— 


i Table of Normal areas this gives, by inverse reading, q = 0.674 => О; - 
574). Symmetrically, u — О, = 0(0.674) so that Q = 1 (Q, — 01) = (0674) o = (2/3)0. 
| Sion] 

. It is an old name for quartile deviation Q. This may also be defined 
< u + Q} = 1/2. Now 

= P(n-Q«X«p*Q)- P-QIo) «Z«(Q/o)) - 2w(Q/o) 

= 1/4 > Qlc = 0.674 so Q = (2/3)o. 
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P IET 0.50 


2. 0.50 


4. Мейіап : 
Let X = т be the medonal value ; then by definition 


5 = оа fod уо): fto ded 2 — 


$ ] 
тЫ" 1 | 
m =), f(x) ах + j (i) 


where z = (x — џ)/с and Е f(z) dz = 112. $0, 


| 1 

2 = J, 004+ => f, f(dx=0 > m=p ГА). > 0]. 
Aliter. Since Мү, с?) is symmetric about X = р, it follows that и is the medonal value. 
In fact Р(Х < и) = 1/2 = Р(Х > р): 


psc a ab 
bx exp[-(x - Ш /2o7] 


zn» 
BED V 1 
i "wo i ag == РОХ <р). 


5. Mode : 
The modal value is the variate-value that corresponds to the maximum probability. Here 


i К Ср ера É 
etitm =i ne ту= (сут)! - (x - p)?/20?. 
Differentiating w.r.t. ‘x’ we obtain 
(y'/y) = -(x-p)/o*; (y"/y)-(y'/yy? = —(1/6?). (1) 


Putting у = 0 we get x = р and from Eq. 1(b) y" = —(y/o?) < 0, since у= (с/у! at x=}. 
Thus X = р is the mode of N(y, o°). 


Maximum Probability : max f(x) = (oJ2n)' , [atx = р, ie. at mode]. 
Observation : Mean = Mode = Median (each = y). 
6. Points of Inflexion : 


Analytically, inflexion points are defined by the solutions to equation (d’y/dx’) = 0, 
(dy/dx = О). Here 


y= (х) = же”, in y =bn (o 2x)" - (x р)? / 2e? К) 
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ntiating twice w.r.t. x we obtain 


y= -x-g/o; Q"/y – (у – у) =-1/0? ...(2) 
| y" =0, we get from (2), (хр) 2o >x=p+0, (3) 
ing for x from (3) into (1) we get, y = («Оте oy. 


‚ the points of inflexion are given by A[u+o,(oV2ne)'] and B[p - 0o, (су2ле) |]. 
À = P{u-0<X<p+0o}=P(-1<Z < 1)=0.6806. 

i gl between Flex-tangents : 

n, m' be the slopes of the tangents at inflexions points A and B; then from §5(2) 


ae АГЕ m = (с? J2ne)', т = (с242леу! =- 


m'-m 2/0’ V2ne 207 J2ne 
MEN и eU EH 
l+m'm |-(1/o*.2me) 2neo*-1 


г nts at A and B are 
p е пе) = т(х-р-о); y- ГҮМ ne)- m'(x— p * o). mb 
E" from 1(а) gives x = р and putting x = p into (а) gives y = 2/6 у2ле. 


int of intersection of the flex — is Cuz с у2ле). 
Eos ША а, 
ut Problems 


is M(O, 1) ) then | gi x1 A. 


man om, Parlor, As; 


10) жүз af ул ё B bne А ғ: | 
т ‚8 ET E age Pihi [ers ta] 


Ие! 


(2л SRS eo из от ds 
dub Hai wie SLEY 
NV "m aw ‘aha ин! aside! Bains Hore 
E * ] í Á 
t vrl pm Йэ 36! 5: 
mA, А v "i 
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Example 2. Show that for normal distribution, the quartile deviation, the mean deviation 
and the standard deviation are approximately in the ratio 10 : 12 : 15. 

Solution. We know that, for N(p, o^) ; Q.D. = (2/3)с, M.D. = (4/5)с, S.D. = o 

Q.D. : M.D. : SD. = (2/3)o : (4/5)o : с = 10: 12 : 15. 

Note. For complete solution; these results have to be derived instead of being quoted 
Example 3. Let W = 25 where Z is N(0, 1), show that Fy(w) = 20(w'’”) = 1. 

Hence deduce the median and the interquartile range for W from that of N(0, 1) tables 


Solution. F {w)= P{W < w} = IZ < w} = P(-Jw < Z< dw) -2y (Jw) = 20 (w^) - 11) 


Since w(k)* 5 = dXX). [Draw Figure] 
Deductions. If W = m is the median, then А(т) =5, and Eq. (1) gives 
Ф(/т) =1(1+ 1) = 3/4 = 0.75. Scanning the area table N(0, 1), we find Jm = 0.675, so 
that m = 0.456. 
If О, and Q, are the lower and upper quartiles of W. Using F(Q,) = 4, F(Q,)=3/4, 
Eq. (1) provides ®(/Q,) = 7/8 =0.875, ®(/O, ) = 5/8 = 0.625. 
Scanning once again №0, 1) areas, we find IN HIS. JO, = 0.32, 
: Q, — 0, = (КЇ ООВ 1.3225 201024 = 1.2201. 
Note. Later on we shall see that W = [N(0, 1)]^ is d. So we can read the values of 
median and quartiles immediately from X, -tables. 

Problems with Solutions Provided at the End of the Text 


1*. If two Normal universes A and B have the same total frequency but S.D. of 
universe A is k times that of universe B, show that the maximum frequency of 
universe A is (1/k) times that of universe B. 


2*. 5000 variates are normally distributed with mean 50 and probable error 13.49. 
Without using tables, find Qj, О,, X (mode), M.D., S.D. Find also the variate 
value for which the cumulative frequency is 1250. 


16-40. Moment Generating Function. Ch. Function & Cumulants 


М) = ett tte), M(t:Z)=e" _ [$8.16(8)] 
M(it) = e" (m. M(t:Z)-e"" [89-20] 
K(t:X) = InM(t:X)-ut*io'! => Xk(r'/r- ur (6217 /2). 


So comparing the Coeffts. of t/r! on either side we get k, m py Kk, = o, k, 20 for 
wd, $$... 


ч i ye pia)" {20° LI OD eA 
A E EE ор S oz 
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O 
16-41. Worked-out Problems 
gxample 1. If X is №0, 1) and Y is N(0, 1), prove that 
Var (sin X) > Var (cos X) 


(a) 
(b) EIX -YIs 48/7, for any relation between X and Y. 

Solution. (a) Here E(e™)=e" = E(cos X +isin X) = e; E(cos2X +i sin2X) =e”. 
Thus, 

Ecos X) = e"? E(sin X) = 0, E(cos 2X) = e°, E(sin 2X) = 0 (Equating real and imaginary parts) 
Var (sin X) = E (sin^ X) - [E(sin X) =E[(1 — cos 2X) / 2]= (102 e°) / 2 = 0.4323. 

Var (cos X) = E(cos? X) - [E (cos X) = E[(1 + cos23)/2]- e! = L(1-e)' = 0.1997. 
Thus, Var (sin X) » Var (cos X). 


NT 
T © i 2 г -1,° 2 
2 | cae Ану Tee 2 E 2 
(ii) ЕК SON hè vrai hore, we Sh ve = 


IX-YI «IXI«IYI > EIX-YIsEIXI-EIYIZ2 2.2/1 = 48/7m. 


Example 2. Let Z = XY, where X and Y are independent variates with P(X = +1) = а апа 
Y~ №0, 1). Show that Z is №0, 1), that Y апа Z are uncorrelated though not independent. 


Solution. M(t: Z) = Ее?) - Ee" )= е” ШТУ”. | [By double-E Rule] 


= dell + Ler =e! 2, 

Thus Z ~ N(0, 1) 
Now E(X) = 1.(4) +(-1) (4)=0; EYZ) -E(XY^) - EO) EY?) - 0. 

Cov (Y, Z) = E(YZ) - EY)E(Z) = 0 = Y and Z are uncorrelated. 
Since Y and Z are N(0, 1); the point probability P(Y + Z = 0) = 0. 
Now assuming Y and Z are indep., we have 
0= PIY + Z=0]= P[Y(1+ X) -0]- РУ =0) € (X = –1)] = (Y 20) + X 2-1) 20 1 
The Obvious contradiction implies that Y and Z are not independent. 
Example 3, For | p | < о, 0 <р < 1, let X be a mixed variate such that 


Жу) = P(oV2n)! е7“ o< x < oo ; omitting non-neg integers ; f(x) = 0, otherwise 
sane (pe A ial, £=0,1,2,3.... 


the m.g.f. and hence or otherwise obtain Var (X). 
Чоп. Using the m.g.f. of N(y, o?) and Pois (A) we get 


Find 


1 
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A s 2 J А jul + ot’ ifs з „д 
M(t) = p[m.g.f.of №, o7)] + (1 - p) [m.g.f. of Pois.(À.)] = ре + (1— p)« 
Expanding the exponentials involved, writing q = 1 – p, we get 
Aur 3-13 12...) 


M(t) = р1+ (qu 107) 1(u io) +...]+де 


- рпа prt (o? p) /24..] al 8X (1 00/24.) 1 8 772 ar +...) 


E(X) = Coeff. of t= ри + gh; ЕХ?) = Coeff. of 41? = p(o^ + p^) + 40, + X^) 
Var (X) = p(o? + н?) + 4(А + А?) - (ри + qÀ}? = po? + qù + palh — А). 
Problems with Solutions Provided at the End of the Text 
1*. If X is №0, 1), find the p.d.f. of Y=k X’ and Z = 2Y. 
2*. If M, (D) = e"** , find P(-1 < X < 9). 
3*. Let X be Mu, 1) and Y = [1 - Ф(х)]/ф(х), where Ф and E denote the c.d.f. and 


p.d.f. of N(0, 1) variates respectively. Prove that EX ya) = р І 
4*. If X, Y, Z are 1.1.4, №0, 1) variates, Show that 


= (X+YZ)/J1+Z? ~ М(О, р). 


5*. Let X бе Nii, o°). Define (i.e. generate or simulate) a r.v. Y that has the same 
distribution as X and is negatively correlated with X. 

6*. A random variable X has E(X”) = 2r!/2' (r ), EX") 20, r= 1, 2, 3, ... Find the 
m.g.f. and p.d.f. of X. 


7*. Prove that if the independent variates X and Y have the p.d.fs. (h/ An) e" ала 
(kI Jn )e * ] then the variate U = X + Y has the density (LINT) grr жа г? a E p 

8*. Let X be N(0, 1). Find the characteristic function of (X — a^), where a is constant. 
Deduce : k, = 2^ ! (3 ra’) . (r — 1) ! where k, is the rth cumulant of (X - ay. 


16-50. Moments of Normal Distribution 
1. Direct Evaluation of Central Moments. For X ~ N(y, o°), definition of p, gives 


» aa п) /2e? -17 x-y 
-gx-wr- а-н а oe [4 


When r = 2n + 1 (odd integer) the integrand is an odd function of z and hence the 
integral vanishes. This gives ji, , , = 0. When r = 2n (even integer), the integrand i5 2" 
even function of z and the above integral can be expressed as 


-ig 


2n ; 
> be ч JM 
e uy P * 1/2) ! du, Ш=1: ] 


ne? 2"g 
= 207" 2 2и d = = 
Hon, Е Jon 1 rà We f; 
= (2" o^ / Jn)T (n4 1). 
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(2n)!( в? Y 
im = =) А te 1)- mid (1) 
(n!) (2)" б 
_ Qm. Qn- [c 
n wJ =; Han =(2n- I) c? Hoa- 2 


D» 2 
2 т^ (к + 1)с р, (Moment Recurrence Formula), (k = 2n - 2) ...(2) 


through M.G.F. 
E tred variate N(0, o 3) 


E X-y) = e"M(r:X)e e?" . [8 8-16(6)] 
ег r series for either side we get 


EST GU X8 Ge (2r) Po?” 
x r=0 ri ied r!Qy ATE E. (2) 


-powers of ¢ in (2) and hence p,, , , = 0. Now equate the Coeff. of 
-=@ 
Ei 
a di» D - d 
IH = S. oat ЗЭ) 


Using relations between p, and H) we get 

; 314 2-365; ba) =H- АРТА = (11+ 30°). 
foment Recurrence Formula 

с “Hon Eo “ан, / do] dcs at Hl 


swf is \ fee E sa 


oe fa ESI. B ua seen 


d! bn 


wW w= Lt "Mee 


dieat 


ary si^ SENA mn. v». 
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We now substitute (i) into R.H.S. of (1) and use 


o^u,, + o" (du, / do) = c^u,, * 2no^y,, = (2п+ 1) си, = И, 


Normal (Gaussian) Distribution k. 
moment recurrence 


[by 916 ©; 


Реагѕоп 5 Coefficients 


Since 


Example : 
normal r.v. 


Solution. 


By DUIS 


Ey’) 


D(u,) = 26, Eq. (1) gives 
и, = of «o? (20) 23o* = p, = апа В, = n, 7n 
Folded Normal distribution. If X ~ N(0, с”), find the density of foldeg 
Y =| X | and evaluate p,. 
ЕУ) = P{IXI< у} = PI-y X < у}= 2Р(0<Х < y) = 2 |, fy (х) dx 


1 


: Еу) = 2f,() = 2(042x) | exp(-y’ /20^),0 « y < %. 


* 
[* y “1 2/25? dy = o Te fe -f Г чайны ИШ ! dz E = * An | 
o 2 


Te 
lo" (42)/ Jn]T [(r + 1) /2]. 


E(Y) = o2/ n) ,E(Y?) 2 o?, E(Y?) = (V8 / n)o?, E(Y*) = 3o*. 


Маг) = EY?) -E*) = ey) 10-1 3a в = [2 (4 - 


4 JEN 


ug) = py – 475. ш + бі; .H - ии)“ - o*[3- (4/ x) - (12/ 1)? ]. 


Hz fe nette 


у, = JB = (4 Е ) t E zb E - йг" = 09953, В, = (3-4 EX. 12 С > ay = 38692 


Problems with Solutions Provided at the End of the Text 


For a certain М(и, o^), the first moment about 101 is 40 and the 4th moment abou! 
50 is 48. What is the mean and S.D. of N(p, 0°). 


2*. If X ~ Np, с ^. find the mean and variance of Y = tX- u) Zot. 


16.52. Linear Combinations of Normal Variates 

If X ~ Ми, o°) and Y ~ N(p', 0”) are independent variates then aX + bY + c is MOF 
+ by’ + c, ас? + b/o"), where a, b, c are constant. [Proof in $ 8-18 (1)] 

Cor. Reproductive Property or Addition Theorem : X + Y ~ Х(р + Ww. с? + о"). 
Note. Extension to n independent variates is obvious. 


165.55 " J | 
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16-53. Distribution of Mean of n i.i.d. Normal Variates 
9 
L 2 ‚ = ^ V t i А 
Let X; ~ N(p, 0°), i 1, 2,...‚ n be 1.1.4. variates and X =X, /n. 


M(t: X) 


Ш 


M(t: УХ, /п) M(t/n:X,+X,+...4+X,)=[M(t/n:X,)]" С X,arei.i.d.) 


ii 


[eX а gh n = grito 
This shows that K~N (u, o? /n). 


16-54. Independence of Sample Mean & Sample Variance of М№и, сї) Population 
Let X,, X5, ... X, be i.i.d. N(0, 1) variates. Then mean and variance are defined by 


X = (Ex. &- [Eo -3y |/n-» 


We show that X is independent of (X, – X). We use MGF technique. 
M(t t) = Ее 20% -¥)) Ее nx) [Def. of 2-dim m.g.f.] 


tt ~ 
= e| exp ( | > 2 ) =X; + (i z f - ty x| | [>Х, consists of (n — 1) terms, has no X,-term] 


= E(exp [(0Y) + (t; + 0) X;], [0 = (4, -t)In, Y - Xj] 


= Efe” ).E(e ^ *9*), [by independence of X; and Y] 


Now Y ~ N[(n – 1) р, (n – 1) o?], АХ NU. o°), we use m.g.f. of normal variate to obtain 


M(t, t) = exp[(n-1) 20 +5 (n- 1) o?0?]. exp[n (t; +0) +407 (r + 0)°] 


ехр{ш +262100 - 0* + (22 + 21,0 + 07)]) 


exp [ш + $ (c? /n) 12].ехр (0r, + z [(n — D/n]o^t?) 
Ma,:X).M(5:X,- X)»  (E(X%,- X)=0, Var(X, - 3) - 3l(n- o с? /n] 


By Factorization Theorem, we conclude that X is independent of X, — X, and these 
аге N(u, с2/п) and N[0, (n — 1)o^/n] variates. 

As suffix is arbitrary, X is independent of each X, ~ X, X, -X,...,X, - X and hence X 
is independent of the function $? = [Z(X, - Xy M - 9. 

16.55. Mean and Variance of a Truncated Normal Distribution 

The density of N(p, в?) is truncated for X < a and for X » b and we evaluate mean and 


variance of the truncated distribution in a € X < b. 
Put z = (x - џ)/с so that x = p + oz. Also a, = (а ~ p)/o, b, = (b — uyo. Now 


Pla« X <b} = p={a-# ХЕБ ара <Z<h)= f” Ф) dz = Ф) - da.) =1/2 say 


500 Normal (Gaussian) Distribution | "T" 
The p.d.f. of truncated distribution is 

g(x) = f(x)/ P(as X <Б) = А f(x), ф(х) =е епу". 
 E(X*) = f? g(x) x*dx = Ap (и + сг)“ ф(2) dz 


Е(Х) = A [ (и + oz) (2 dz - An [; (о) dz + he |, z@(z) dz 


spare grs pioli QAO Qan )- £s | Ф(Ь,)— (a) | 
а Jm Jom уж Ф(Ь,) — Dla) | 
E(x?) = Af? (u? + 202+ 072") (2) dz = M [ C) dz + 2907. fa ZO) de + o |а zo); 
=p? — 2noA[e(b,) – ọ(a,)] + в?) r S; ик [by (2)] 
| І a От ..(3) 
Integrating by parts the last integral Т (say) in (3), we get 
=g ЖА = 
Т = [en] «ps = [a, p(a,) — b, Ф(6,) + (1/2) 
Substituting the value of T in (3) yields 
Е(Х?) = (p? + 0°) — 2noA[e(b,) – Ф(а,)]— 0° [b ф(®,) — a, (a, )] (4) 
Var (X) = Е(Х?) – E^(X)26! (1- X [o(5,) — Ф(а, o - A [b p(B, ) — a, Ф(а;)]). (3) 


Special cases : 

(i) If b = oo so b, = œ then ọ(b,) = 0, b, q(b,) = 0 (L-Hospital Rule), (5) = 1. 
E(X) = p + Лоф(а), Var(X) =0° {1+ Аа o(a) - Xia), A= VU Фа). 

(ii) If a = — so a, = — then ф(а,) = 0, a, 9(a,) = 0 (L-Hospital Rule), P(a,) = 0. 


E(x) == Аоф (В, ), Var(X) = o? (1 - Ab, olb) - 2 CUAIRT DT 1/Ф(Ь) 


16.56. Worked-out Problems 

Example 1. Let A ~ N(45, 4) and B ~ N(44, 2.25) be independent. What is the prob. tha! 
(i) two variables from A differ by 1.5 or more, 

(ii) two variables from B differ by 1.5 or more, 

(iii) one variable from A and one from B differ by 1.5 or more. 

Solution. Let X, є A and Y, € B, i = 1, 2. Then 


E(X, -X,)= E(X,) - E(X;) = 0; Var(X, e X,)= Var(X,) + Var(X,) = 8... (Х, ü X,)~ N(0, 8), 
E(Y, - Y,) = Е(ү,) - EY, ) =0; Var(Y, – ¥,) = Var(¥,) + Var(Y,) = 4.50. ~. (Y, - №) ~ N(0, 450). 
Let Z = [(X, - X,)-0)/ V8 T = (Y, - Y,)-0]/ V45. 


() Р(Х - Xj) 2 1.5}= P(Z > 0.5303} = 0.5000 — 0.2019 = 0.2981. 
P{ |X,- X,! 2 1.5}= 2 x 0.2981 = 0.5962. 


$1 6-56. Worked-out Problems 50 1 


P{(Y, = Y) 2 1.5}= P(T 2 0.71) = 0.5000 — 0.2612 = 0.2388 
Р{ ! Y, — Y, |> 1.5}= 2 х 02388 = 0.4776 (as above). 
) Let X e A and Y e B ; then letting U = X — Y, we get 
E(U) = E(X) - E(Y) = 45 - 44 = 1, Var (U) = Var(X) + Var(Y ) = 6.25 
P{U < 1.5) = P(U*20./4625)- P(U *202) = 0.5 — 0.0793 = 0.4207 
Let V = Y — X, then E(V) = -1, Var (V) = 6.25 and thus 
P(V215) = P(V*22.5/4625) = P{V *> 1}= 0.5000 – 0.3415 = 0.1587 
Thus P(IX-Ylz15) = P(U21.5)+ Р(У > 1.5) = 0.5794. 
Example 2. Let X and Y be independent N(0, 1) variates. Show that aX + bY and 
a'X+b'Y are independent if aa' + bb' = 0. [Thus X + Y and X - Y are always indep.] 
Solution. M(t,, t,) = E(exp[t, (aX + bY) +t, (aX + b'Y)]) - E (exp (ar, + a’t,) X + (bt, + b't)Y]] 
= E {exp (at, + a't;)X) .E(exp(bt, + b't,)Y}. [X & Y are independent] 


= exp} (at, +а'1,)? -exp } (bt, 4 b't Y s exp (a! +)? +a? p^ + (aa!  bb')t,t;) -. 


(1) 


(ii 


(1) 


Thus M(t, t) = M(t,). M(t.) = [exp > (a? + 62) à exp (a +b’) r5, iff aa’ + bb’ = 0. 
Under this condition, aX + bY ~ N(0, a’ + b^), a'X + b'Y ~ N(a"? + b°). 

Note. Cov (aX + bY, a'X + b'Y) = аа + bb’. For bivariate Normal distribution. 

oj = 0 e X, & X, are independent. This proves above result without using M(t,, ¢,). 
Example 3. Let X and Y be independent N(0, 1) variates. Let X = R cos Ө, Y = R sin Ө. 
Show that R and © are independent variates. 

Solution. The joint p.d.f. of indep. N(0, 1) variates is 


fü, у) = (1/2л)е €? , -w<x, y«o. 


Let x = г cos Ө, y = r sin Ө, then A(x, y)/0(r,0) =r. It follows that the joint p.d.f. of R and O is 


g(r, Ө) = fl, у) | |д(х, у)/ (r9) 2 1/2x) (e гу 0<г<®. 0<0 <2л 


The factorization guarantees that R and O are independent distributed, with densities 


g(r) = re" ^,0rzo; №) = (1/2, 0 «0 < 2n. 


Problems with Solutions Provided at the End of the Text 


l*. The expected travel time to four cities C; (i = 1, 
2, 3, 4) is indicated in the figure. The travel times 
for each of the routes are independently 
Gaussian distributed with 20% coefficient of 
variation (C.V.). Two cars A and B start 
simultaneously from C, to C,, with car A going 
via C, and car B going via C}. 
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Ше, 


(i) What is the probability that car A will arrive at С, within 9 hours ? 
(ii) What is the probability that car A will arrive at C, earlier than car B 9 
Find the 1/1000 limits of a distribution formed by the addition of variate 
from each of two independent distributions of equal size, whose parameter 
= 10.5, 0,7224, p, 2125, 0, = 30. 
In an examination, marks obtained by the students in Math, Physics and Chem; 
are normally distributed about the means 50, 52, 48 with S.D. 15, |). н 
respectively. Find the probability of securing a total marks of (a) 180 or abo, 
90 or below. 
If X and Y are independent values from N(0, 9), what is the probability that th. 
point (X, Y) lies between the lines 3X + Y = 5 and 3X + Y = 10. | 
If noX ~ №7, 3) and Un, Y ~ NG, 1) are independent, find the probability of 
1.202: < prn < 83180000. [You may need (п, 1202 = 3.80, AE 8318 = 3.92] 
X, ~ Мр, 07) i = 1, 2, ..., n be independent and Y = XcX, If (Zcji). = = 9(Ус?о2) 
find P(0 < Y 2с}, 1 <i<n. | 


Exercise 16(b) 


are 


. (a) For a normal distribution, the first moment about 8 is 22 and the fourth moment about 30 


is 27. Find the normal distribution. 

(b) If X, Y, Zare i.i.d. №0, 1) variates, find the mean and variance of U = X + XY + XYZ. 

(c) If X ~ N(O, 1), find Corr (X, Y) where Y= zat eX. Using Chebyshev's inequality show 
further that P{ | Y-a-—clsa/2}21- VIT + 2c ya Ay 


[Ans. (а) N(30, 3), (b) и = 0, o? = 3, (с) p= b/ Jb? +2: 


. If Xis N(p, o^), for what value of c, Е(ех - с) is minimized. [Ans. exp [u + (с2/2)] 


If X is №2, 3), find the p.d.f. of Y= (1/2)Х - 1. Using tables, find P{ Y > 3/2]. 
[Ans. N(0, 3/4), 0.1587] 

If X ~ N(1, 4) and Y ~ №2, 4) are independent, what is the p.d.f. of Z=X+2Y? — [Ans. N(5, 20)] 
If X,, Х„ Ху, X, are 14.4 N(100, 25) variates and X = 4 (X, +...+ X4) , find the p.d.f., me 
and variance of 
(a) 4X, (b) X, - 2X; + 3X - 4X4, (с) [Z(X; - 100)2]/25,1<1< 4. 

[Ans. №400, 100), N(-200, 750). T 
If X, Y, Zare indep. №2, 1), №3, 2), N(4, 3) variates, find 


(a) P(X<Y), (b)P(3X-2Y21), (c)P(X+Ys2Z-4), (d) P(Xs ү.2<5). ^ 
[Ans. 0.718, 0.4052, 0.3974, 0.- 


Let X, Y, Z be independent N(2, 2), N(3, 3), N(4, 4) variates. Find -— 
(1) P(Z «2. <4Х- ү<2+3), (ii) Pa Y,Z-3>0). (Ans. 0.0619, 0.27 


. Let X ~ N(p, o 2) and Y ~ N(2p, 20°) be independent. Find, 


(a) p is o = Запі P(X + 2Y < 10) = 0.3, (b) o = O if u and P(4X – 3Y > 3) = 0.4. 
(c) рапісіѓР{ 12Х- Yl» 10} = = 0.05 and P{Y 2 0} = 0.9. 082899! 
[Ans. н = 2.945, с = 2.057983, (c) p = 1.826191, 0 = 2. 


© 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 
19, 


20. 
21. 


22 
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„ Suppose Н Ф (a, b) . At what o will the probability p = P(a € X € b) be the maximum ? 
10. 


(a) Find the probability that the line joining (X, Y) to the origin makes an angle with X-axis 
which is less than 7/6 in absolute vlaue ; X and Y indep. N(0, 1) variates. 
(b) Let X and Y be independent N(0, 1) variates. Find the probability that (X, Y) will fall in the 
rectangle whose vertices are (1.2, 0.8), (1.6, 0.6), (1.9, 1.2), (1.5, 1.4). 

[Ans. (a) p = 1/3, (b) p = 0.00895] 
If X М (6, 9) and Y~ N(7, 16) are indep. determine A such that P(2X + Y< À} = P(4X - 3Y 2 A], 
where k is a known positive real number. (Take k = 4). 


[Ans. А = (3413 41142)/ (64/13 + 642)] 
If X ~ Ми, 9^) and Y ~ Лр, 122) are independent and if P(X + 2Y <3) = P(2X — Y > 4), determine 


y. [Ans. р = 1.85] 
If X ~ №, сү) and Y ~ N(p,, o^) are independent, find the relation between а, B, y, 5 such that 
P{(aX + bY) <a} =y, P{(aX + bY) <В} = ё. [Ans. F[(B – р/с] - (о – u)/o] = $ - v] 


If u! =E(X’) is the simple moment of №, o°), prove that 
Ur,» = Imp), + (5? - m^) u; +0° [dy] / do]. 
The third decile and upper quartile of a N (p, o?) are 56 and 63 respectively. Find p and с?. 


[Ans. р = 59.0608, с = 5.83] 


A normal population has a Coeff. of variation 3% and 75% of the population lies below 110. 
Find the mean and variance. [Ans. р = 108, с = 3.24] 


Given №75, 8?) population, what limits will include : 
(a) The middle 50% of the total frequency, (b) The middle 75% of the total frequency. 
[Ans. (69.60, 80.40), (65.80, 84.20)] 


ИМ) = e" * 2", find P(-2<X<6). [Ans. p 0.3820] 
Let X,, X», X, be i.i.d. Ми, c?) variates and suppose that Y, =(X,-X,) np: Y, - (X, - 2X, +X 
V6 „апі Y, = (X, + X; + XY V3 . Show that Y,, Y, Y, are independent normal variates. Show 
also Y + Y7 = (X, – Xy +(X, - Xy + QC +X)’, where X = $(X, + X, + X4). 
IX - N(p, 0°), findflx:Ix-plsko). — [Ans.gQ) = ехр[-(х - н)? /26? Io 2x . 2y(k)] 
Consider the p.d.f. Жо) = JOUL - F(%)], x 2 xo where 
fo) = (2лс2) 12 exp[-(x - p)? /26?], -©< p «o, 0 2 0; and F(x9) = P(X < xo). 
Show that the first two raw moments р’ and р, can be expressed as ш =p + Ao, 
H, =p?’ + Ас (x, + н) + 0° where A[1— F(x9)] = fixo — 1)/ с]. 
If X is N(0, o^) with density f, show that 
E 1 
E X = 2 d == " 
ШП = VGN а 


Hence show that if the normal distribution is grouped in intervals with total frequency N, and 


N, is the sum of squares of the frequencies, an estimate of o is N? /2 №, Ул . 


E 
| » 
ў 
А] 
- 
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23. IfXis Му, o^), show that E(1XI) = су2/ л exp (-à? / 20?) + 2p Ф (р/с) where ® is the, Р 


of N(0, 1) variate. 
24. If X ~ МІ, 1), compute the covariance matrix of the random vector Y = (X, X', Y^ 


| 


25. Determine a and b such that f(x) = (ш [exp(-4°)| (ax + bx За), -o«x«« | 


p.d.f. of a variate X and E(X*) = З[Е(Х?)]?. Prove that E(X) = 0 and Е(Х?) #0. 


26. Let X and Y be independent N(0, 1) variates. Find the joint p.d.f. of Z= (X + Y) and w X/y 
Find the marginal densities of Z and W and show that these are independent. 


Sa 


27. If X and Y are independent №0, 1) variates, find the joint p.d.f. of Z = "Ta +Y?) and 


W = tan! (X/Y). Are Z and W independent ? 
28. Let X and Y be independent N(0, o?) variates. Find the probability density of 


Z= tan! [X/(a- Y), -17<2<57. 


16-60. Importance of Normal Distribution 

The normal distribution is of great importance in Probability theory and statistics. In 
nature and technology, we very often deal with distributions which are very close to 
normal distribution. This phenomenon is an object of investigation of the theory of 
‘Stochastic processes. Some facts of Normal Law are as under : 

1. Normal law approximates the p.d.f’s. of most of the commonly occurring 
distributions such as Binomial, Poisson, Hyp-geom, Students’ t, etc. 

2. Many of the Sampling distribution such as students t, Snedecor's F, Pearsons x 
etc. are asymptotically normal. In fact most sampling distribution tend to normality as 
n—> ©. 

3. A non-normal variate sometimes begins to exhibit normality properties under 
suitable transformations. 

4. If Zis N(O, D, then Р{ 1212 1.96} = 0.05 ; P{ 12123) = 0.0027. These properties 
of N(0, 1) form the basis of *Large Sample Theory". 

5. For large number (» 30) of variate observations, the sample can always be treated 
as normal, even though the parent population is non-normal (central limit theorem). 
6. In most “Tests of Significance" the parent population is assumed to be normal. 
7. ‘Normal Law’ is used in “Statistical Quality Control” and graduation of non-normal 
curves. 


16-70. Some Important Theorems 


1. Circular Symmetry Theorem. The variates X and Y are independent and their jo" 
density fyy (x, y) has the circular symmetry (rotation invariant) 


fx, үх Y) = ју Ar), r= x+y 
Then X and Y are Normal. 


Proof. We let fy y(r) = g(x" + y); use independence of X and Y to obtain 
ло) ЛО) = 802 + у?) 
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Differentiating this equation w.r.t ‘x’ yields Minis iod ^ m" 
tof). = 2xg'( + y^ sit) 

pividing Eq. (ii) by Eq. (i) gives 


E g(x + у”) 2xf (x) g(x? à у?) 
Differentiating (i) w.r.t ‘у’ gives іп a similar fashion 
EU vc» 
2y f,(y) gx + y?) 
Eliminating g between (iii), (iv) and gives 
Lf) / xfi]. = U/ у ОЛ M s, 


The L.H.S. of (v) is a function of x alone ; the R.H.S. of (v) is a function of y alone and X. 
Y are independent, it follows that each member of ae must be the same constant. Hence 


Ао) хх = С => dlinfGo)/dx- ivi) 


.. (il) 


...(1V) 


Integrating: фп р(х) = 1Сх? +b or eaim 


Since i^ f(x) dx «1; it follows that C is necessarily negative ; (If C > 0, the integral 
shall diverge) write C = af; get 


fj e» = ke" 20? 
This proves that X is №0, с 2, From (v) and (vi) it is obvious that Y is also №0, с af 
Thus X and Y аге i.i.d. N(0, с 2) variates. 
2. Bernstien's Theorem. If X, and X, are independent variates with the same 
distribution, which has finite vanae anti m.g.f. M(t), and if Y = X, + X,,Z- X, - X, 
are independent then all variates Х|, X3, Y, Z are normally ныне, 


Proof. We evaluate the m.g.f. of Y and 7. 


M(t t,) iat eee eee е e (er el 75 \ 
1? 3 


= E (e tD] Be 7) = M, (t t). Malt; 5) (i) 
Since Y and Z are independent, M(t,, t,) = M(¢,, 0) МОО, t,) and so 
M(t,,t,) = Ее" )E(e2”) = Ep" JE [e^ -Х2)] 
Eel) Ee ) E(e ^ ) Ee ^) = M(t,) M(t,) Met) Moe) 0) 
Equating (i) and (ii); using Ө = t,, Ọ = 7, for brevity, we get 
M(8--9)M(8—9) = М?(Ө) М(ф) M(-9) n) 
We differentiate this equation w.r.t. ‘@’ and obtain 


МӨ +o) МӨ — 9) - M(0 +G) М'Ө 9) = M^()EM'() M-P) - М(ф) M"C)] 
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Differentiating this equation w.r.t. ‘o’ we get 
M"(0 + 9) M(0 — 9) - 2M'(0 + 9) M'(8- 9) + M(8 + ф) М"(Ө -ç 


= М?(Ө)[М"(ф) M(-o) - 2М'(ф) M'(-9) + М(ф) M 
We now put 9 = 0, using M'(0) = р, M"(0) = н'„ M(0) = 1 and get 
M"(0) M(8) - 2M"*() + М(Ө) M"(8) = M7(8) [u; - 28° + н] 
or MM" -M° = M’o’, i.e. o? = (MM" - M")! М? =d(M'/ М)! d9 
Integrating : M'IM = g?0- A-6?0 +. [^ M'(0) = p] 
Integrating again: (nM = 20292 +р0+В [B=0as 8 = 0] 


М(Ө) = tt pw 


This is the m.g.f. of N(p, с a. It follows that X, and X, are from the Normal distribution, 
У and Z being linear combinations of Х,, X, are ано normal variates. 


3. Price’s Theorem. If X is N(p, с 5 then (writing v = С 2) 


"1 xf S o| Sodi T Ee «бю = E(D^ g(X)) 


where g(X) is an arbitrary function of X and D = d/dx. 
Proof. By Inversion theorem, p.d.f. in terms of Ch. Function is given by 


foo 1 xf е" фа) dt ; Ф) » e»- n"? (р) 


ELO] = Г. #00) in [„ е^ en at} dx 


Since (t) depends on v(= Е" differentiating above Eq. w.r.t. “у” n times we get 


?) 


‚СЕ ОЛ = 5 +f g(x). [e^ ф00), 112)" dt dx 


ives 


because ae taille g(t). Also, differentiating (1), 2n times w.r.t. x. 8 
NE 


D'"f(x) = zd e" (2 )"o(t)dt, (Си = (-1)") 


= 5 D fd уо) & 0) % 


Integrating E parts Bata and assuming that g(x) does not tend to infinity 19 
rapdidly, we obtain 


[^ во) D"fG)dx = | UD" g(a) fx) dx 


(5) 
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The stated result follows from (4) and (5). If o? = у = 0, then X = и = gnum ) i Бела 


E[g(X)],. = (Н). 
Note. The process of integration in (5), when n = 1, can be easily demonstrated. 


Assuming g(x) © too rapidly, e.g. if for some C and any х. | g(x) | < C exp Gn «2, 
then 


[* g(x) D'fdx = [9(x) ру] - ^, g(x) Dg. Df dx «0 - f^, Dg. Df dx 


-[Dg. f(x], + [5 Dg. f(x) dx = | V D^ 81. f(a) dx. 
4. Gaussian Law of Errors. Under certain assumptions, the errors in the observations 
follow Normal probability law. 


Let X,, X5, ..., X, be the n measurements of a physical quantity, these measurements 
are made independently and are equally reliable. If X is the best estimate of the quantity, 
the error in the individual measurements are : 

e,-X,-X, e-X,-X, ...... а=, ЖО.» e.=X,-X. 
Obviously, e, + е, +... + e, = (X, +X, +... + X)—- nX. 
Let us assume that the probability of making an error e is ф(е). Since the measurements 


X, 1 <i X п аге made independently of each other, the probability P of simultaneous 
occurrence of individual errors €j, ез, -> €, is given by 


P = $(e)6(6) ...9(e,) = €(X, - X) &(X, - X) ...$ (X, - X). lr 
It follows that P is the function of the best estimate of the physical quantity. 


Assumptions and their consequences : 
1. The positive and negative errors are equally likely. For precision 

ete tte cÜ > X-(XX)/n- X, 1<і<п (2) 
i.e. the arithmetic mean X of the measurements is the best estimate of the value of the 
measurement. Assumption 1 requires that o(-e) = ф(е). 


2. Small errors are more likely to occur than the large errors. Assumption 2 requires 
that ф(е) is a decreasing function of e, for e > 0. 


3. Errors of great magnitude do not occur. 
Assumption 3 requires that ф(е) > 0 as e ++ o whe) 
4. Best estimate X is the most probable value, i.e. the value for which P is maximum. 


Derivation of the law of errors : 


Assumption (4) helps to determine the form of ф(Х). Taking the logarithmic differentiation 
In (1) and equating it to zero, we get 


X-X (X, Х) ф'(Х, — X) b'le) , 9 (e) $'(e,) 
"E. ades (5,74) 20 ie. +t... IM = 0) ...(4 
$0,-3) * 6003) 5" * 4003) ^0 1 e) Фе) 7 9e) i 


Where e, + e. +... + e, = 0. (Assumption No. 1). Now (2) and (4) are true for all n. 
1 2 n р 
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When л = 1, we get e, = O and [(ф'(0)/ ф(0)] = 0, so that 

ф'(0) = 0. 
When n = 2, e, = —e, and 


oe) фе) Ce) ү 


(e) ^ фе фсе) ^ 
When n = 3, e, + e, + e, = 0 and (4) provides 
Фе) 9e) _ Ie +e), uu, | 
$e) * e) ^ Hacer eo 0t | 


Partial differentiation of equation (6), w.r.t. e, and e,, provides 


d |€€e)| а [9e)]. | Жел ы 
de, tel " Lee = C, Const.| each = DED 


where г = e, + e, and (ôt/ôe,) = 1, i = 1, 2. Since e, and e, are independent, integration 


of this result provides [ф'(е) / ф(е)] = Се + А, (А = const.). 
When е = 0, ф'(0) = О by (5) and hence A = 0. Now integrating this result in 
ind(e) = 1 Се? + К ог ф(е) = K exp (3 Се?). 
Since ф(+оо) — 0, we must have С < 0 ; we take С = -2h°, and get ф(е) = К exp (-h’e’). 


Now the error certainly lies between —oo and +оо and thus (writing y = error e) 


E sz. у? Б dz K42n ›= z| 
1 = (е) де = К Pd dy- К e co m : LE | 


Thus К = А/./л and so ф(е) = (А/./л) exp (-h?e?), — < e < о. 
This is Gaussian p.d.f. with precision constant h ; the standard error o is given by gia 1 N. 


Note. To avoid e (error) with exponential “е”, write ф(у) = (h/4nz)e ^" , -o < y « * 


16-71. Linear Transformations 
Assume Х|, X,, ..., X, have a continuous joint distribution for which the p.d.f. is ‘f and 
Y,, Y,, ..., Y, are derived from X; by means of a linear transformation 


Y, = aX, +а,Х, * a, X i=1,2, n OI 


In" n? 


Let A be the n x n coefficient matrix, and write 


а dp =» An Y, X у X, 
tdi ү, x X 

Р а, а» x Ys 1 | 2| yal] x= 2 
cn Hoe ж "E Ж. Yn X, 


The linear map (1), in-matrix form, is thus given by Y = AX. 
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Suppose det A = | A # 0, then A" exists and E q. (1) is a One-to-one transformation of 
the entire „ре R" onto itself, At any point (y,, у,, ..., y, ) of А", the inverse map is 
given by X = AT y. Since det (A у= = I/det А = Jacobian of inverse map, it follows that, 


at any point (у|, Y» => Y, ) of R”, the joint density SO Fats.» y.) of Y, Yo, ..., Y, can be 
evaluated in the following manner : 


(i) Replace component x; in fix,, x,, . 
(ii) Divide the result by | det A |. 
In vector notation : g(Y) = (1 det A 1) ДА y), for y e А". (2) 


en Xp ss X,) by ith component of the vector A у 


Linear Orthogonal Transformations : 


If the square matrix A is orthogonal, then the linear map Y = AX, is called /inear 
orthogonal transformation. 


Since A is orthogonal, A = A’ = A^, hence | det A | = 1, and transposition gives 


Y Y = (AX)'(AX)=X"(A'A)X = X' IX = X'X 


Xy E Ex’, (131,2, ..., n) I» 


16-72. Fisher's Lemma 


Let X,, CN ..., X, be independent N(0, с 2) variates. If X, are transformed to new „variates Y, 
p-12,. 2 by linear orthogonal maps, then Y, are also independent N(0, с ?) variates. 


Proof. Let Y = AX be the linear orthogonal map, so that YY’ = XX’ and (det A) = 1. The 
joint p.d.f. of X is 


fo) = (J2no)" exp (-(Zx7 /20?), i212, ..., n 

Since Ex = Ly, (> XX'=YY’)and|J|=[det A]! 241, the above equation reduces to 
go) = (2ny" exp {—(Zy; /207)}, i=1,2,...,n 

This is the joint p.d.f. of independent N(0, o^) variates Y,, Y,, ..., Y,. This proves the result. 


16-73. Miscellaneous Worked-out Problems 
Example 1. If X is №р, o°), find E(X | X 2 a) and Var (X | X 2 a). 


Solution. Let P(X > a) = 1 - Р(Х < a) = 1 ~ F(a) = A, say. We now define the 
truncated density. 


Pn и) 2e? 


f(x) = YS cR x2a;f(x)-0, yea 
l= [А f(x) dx = f eu [z= 228, p= tt | н ор. 


Тһе mean М of the truncated distribution is 


p 
» (p. o2) e" dz pnm 


(M = (P xfQ) dx = f, wow, RAUM ор ae Bt т. (2) 
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„2 ) 
Є ° dz 


[4 
^ o 2 б»... 2 2„2 " — Lm 
EXX^1Xza) = [x feodx-], (y +02 +20n2) Re, (х = (n+ o] 


pu o [^ zt de ^ gut adr [by (1)] 
eee a. LIE b AJ C Ух!) 
2 2.6 —b? I2 в? "1 -7 
a U+ + ze dz. 
^ Ax 2n Ax2n f, 


We evaluate integral involved in (3) 


TESN 02е) а.е]. eI SAL PLE [by (1) 
Substituting into (3) we get 


5p) sp? 
› 2poe E o? be bn 


ТЕЕ + 
AV2n AV2n 


» я dk % ada? boe”? l А a-y] 
Var (X | X > a) = E(X' IX2a)- М =с E T b чүл 
Example 2. If X ~ N(u,, 9j) and Y ~ N(p,, ne are independent, derive the distribution: 
of Z = (X - n)(Y - p,) and W = (X - uy) 1 Y - p, f. 
Solution. We find Ch. Function of Z, using Double-E Rule. Note that X, = (X - u) 
~ N(0, с) and Y, = (Y - ij) ~ N(0, o2). Now 


$(:Z) = E(e*)- EE (e ^"? |y, ) 2 E (e "0170 * 


2 2 
-y'/26 
| -2сї12у? pus f 2 


Е(Х21Х>а) = p 


eo –у2/295 - 2с? /2у? ау 


dy = ——— 
P o, V27 / o, v27 he 
- аг 491192211 A^ [pett Pade dE um aso boi = lid, b" =o} 2| 
This shows that Z is Cauchy with parameter (6,/6,). Thus 

ele, ү, б, 

аы UP "RE 

. Now o(t : W) = $(t : Z) [since | Y, 2 = A yields same results (1) and (2)]. Hence W has 
the same density (3) as Z has. [Another solution in Example 21-8] 

Example 3. X ~ Мр, сү) and Y ~ М, a, are independent variates (и « 2) such 4 

P{4X - ЗҮ < 6) + Р{5Х + 12Y 2 30} = 1 ; P{4X + 3Y < 12)  P(5SX - 12Y x - 20) = ` 


Determine р and 5? /o?. 


) —o«z«o, 3) 


Solution. 

Var (4X + ЗУ) = 160? + 905 = a? (say) ; Var (5X + 12Ү) = 25 62 + 1440, = P (say) ^ 
Using aX + БУ ~ N (ap, + by, а?с М + Ьо), we readily obtain 2 
(4X — 3Y) ~ Ny, a’) ; (SX + 12Y) ~ N(17p, b^), (4X + 3Y) ~ Np, aò, (5X - 12) - МС P" 


$16-73. Miscellaneous Worked-out Pn oble ms 5 1 1 


The given probability statements in terms of Z ~ N(O, 1) are 
P{Z < (6 - p)/a} + P(Z > (30 – 17р)/Ь} = 1 (i) 
P(Z<(12—7p)/a+ P{Z<(7p-20)/b} = 1. (1) 
As N(0, 1) is symmetric about Z = 0, Р(Х < А) = РОС > В), = A = -B. "i 


(i) gives PLZ < (6 — ua] = P[Z < (30 - 17р)/Ь] => (6 – pla = (30 - 17p)/b — ...2) 
(ii) gives PLZ < (12 – 7p)/a] = Р[2 > (7p - 20b] => (12 - Tp)/a = (20 – 7p)/b ...(3) 
Eliminating a and b between (2) and (3) we get 

Mp’ -220 +15 = 0-(n-D (70-15) => р=1, 15/7. 


Since и < 2, we accept only р = 1. With р = 1, Eq. (2) or Eq. (3) provides 5b = 13a. 
Now (1) yields : 


25 (250; + 14403) = 169(1662 +902) = 62-6? or (с2/02)=1. 


Example 4. Let X and Y be independent standard normal variates. Let U = X + Y, 
V= X? + Y’. Show that the joint m.g.f. of U and V is i 


M(t), t) = (1-26) ' exp [27 /(1-2t,)], -œ<t «o, -e«t, «1. 
Hence or otherwise find Corr (U, V). 


Solution. И) = EAEE aY] 


EEE tat’) E (E у (X, Y are iid.) ...(1) 
-x^n 
T € elit the ‚= f 


ла лесния 
[x 4/1 20, - (1810, 0] 2101-0) 

и 12101-0). [и= 120, 01-05); dx =du/ [1-27 
gi е е п _ exp lt; /2(1-2t,)] 

бүтүө -o race (1 21,) 1/2 


Substituting i in (1) provides M(t,, t,) = (1 — ary" exp [t (| -= 2t.)]. 
We сап use cumulant generating function but direct evaluation is neater. Thus 
E(U) + E(X + Y) = E(X) + E(Y) = 0, E(UV) = E[X? +ХҮ?+Х?Ү + Y] 20 
IX, Y are 1.1.4. and odd moments are zero.] 
Соу (U, V) = E(UV) - E(U) E(V) = 0 => Corr (U, V) = 0. 


Now E (e^ *^* ) 


since (1-25) x? — 2х 


Ерен *^* ] 
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1°. 


2°, 


к 


8*. 


6". 
T". 


б". 


- au 


Problems with Solutions Provided at the End of the Text 
Let ф(х) and M(x) be the p.d.f. and c.d.f. of a N(0, 1) variate. Let y have . 
truncated distribution g(y) = ф(у)/[Ф(Ъ) - (a), a « y « b; &(y)- 0, elsewhere 
Show that E(Y) = [Ф(а) — 9(b)] / [Ф(а) – 4(5)]. 
Conversely, let f(x) and F(x) be the p.d.f. and c.d.f. of a continuous variate. X 
such that f'(x) exists for all x. Let 

g) = f(y)/[F(b) - F(a)), as y <b; 8(у) =0, otherwise 

be the p.d.f. of a truncated variate Y. If E(Y) = [f(a) – f(5)] / [F(5) — F(a)] 
for all real a, b prove that X is №0, 1). 
Find the m.g.f. of XY where X, Y аге i.i.d. №0, 1) variates. 
Show that the product of two independent normal variates is never a normal 
variate, but the product of two non-normal independent variates may be а 
normal variate. 
If the variate X, has a c.d.f given by 


G(x) = [(n-1)/n] (x) «n! Е, (х), V x 
where (x) is the c.d.f. of a №(0, 1) variate and Ё (х) is a c.d.f. (of Y, say) find the 
limiting distribution of X,. 
If X is №0, Ө”), show that Y = 1/X? has p.d.f. 
(c4 2n)! y" e e^ 0 € y € oo. 
Hence or otherwise obtain the characteristic function of Y. 
If X, ~ N(0, б); К = 1, 2, 3 are independent, then 
TA Р EX 

is N(0, o^) where (1/o) = (1/с\) + (1/6,) + (1/с.). 
(Hard) If X ~ Мр, o^), find ће m.g.f. and p.d.f. of V = Х2/с2. 
Find P(A) the probab. of an event A if it depends on the variate X ~ N (p, с) 
апа can be expressed by the formula 

PIAI ХІ = 1-е“, х>20, k>0, PIAIXI-O, x<0. 
Let X be a N(0, o°). Let Y be another variate which is independent of X, and ^ 
E(Y) = 0, and is s.t. E(Y*) = 3 [E(Y”))’. If Z = X + Y, show that there is stil! the 
relation E(Z*) = 3[Е(7°)]*. 
Let P(x) be the c.d.f. and f(x) the p.d.f. of N(0, 1) variate. Prove that 

1 \ f(x) f(x) [1 - Ф(х)] 
(a) (1-4) @.1-0 5 == im =———— = |. 

rj Ж (x) a "EM (b) am f(x) 
1 - D(x) 


[x)= fo) ” 


is called Mill’s ratio.] 


Re-statement. x ! (1- x ?)« r(x) &x !, limxr(x)=1. 
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10*. Let go" МОО, 1) be i.i. d. variates, j = 1, 


.. and define Х = Y + Y) uo Y, Show that 
S, In” "on d > МО, с ^ where S, - X, ҮТЕРҮ, 
11%. Let Y; ~ N (0, 1) be i.i.d. variates j = 0, | 


X 


n' 


, 2, ... and define variates : [X,, n 2 0] by 


nl = ax, ht AT Хо=Ү,,а<1, п> 0). 


show that X, is a Gaussian (Normal) variate and X. —“-» N(O c?). 
12*. Find E(cos X) and E(sin X) when X has the following circular normal density : 
JG) = [2n J,(O]'! ek == Юю k 50, OS x «2n, OS B m, 


х/ 2)" F2r 
where J,(x) = i E E (x)= È a | [Bessel function of order 7]. 


Exercise 16(c) 
1. If X- N(0, o^), show that E(e*) b: gen 
2. X- N(1,9) and Y ~ N (2, 16) are independent. If Z = X — Y, write the p.d.f. of Z, state its median, 
S.D. and mean. Evaluate P(Z + 1 x 0). 


3. Let X and Y i.i.d. №0, 1) variates. If Z= aX + bY + c, what will be the distribution of Z ? Find 
Mean, Med. and S.D. of Z. Find P(Z<0.1)ifa=1,b=-1,c=0. 


4. Let X and Y be independently and normally distributed with a common mean. 
If P(X + Y 2 27) 2 P(X - Y <2), calculate the common mean. 

5. If X, (i= 1, 2) are independent and X; is Ni, i^), find P(2X, +4 > 1/2 X, + 10). 

6. Let X and Y be two indep. normal r.v.s. possessing a common mean p such that 
P(X«2Y <5} +P(3X & Y«9] 21; P(X-2Y 3) & P(Y -3X2 1] =1. 

Determine the values of p and the ratio of variances. 

7. A rocket fuel is to contain a certain percent X of a particular compound. The specification 
limits to X are 30 to 35 percent. The manufacturer will make a profit p(x) on the fuel per gallon 
as follows : 

р(х) = 10 cents, if 30<x< 35. р(х) = 5 cents, if 35 « x « 40 or 25 « x < 30. 
p(x) = -10 cents, otherwise. 
Assuming that X ~ N(33, 3), calculate expectation of f(x). 
8. If X is N(O, o°), determine the optimal deviation E, w.r.t. the mean for which P(a < X < b) will 


be largest (0 < a < b). [E is defined by P(1X - p 1< E)= 1). 
9. Xand Yare independent normal variates with coefficient of variations түү! and n;' respectively. 
Show that P(XY < 0) = 1 — 2 erf (n,) erf (n5) where 


erf(x) = A ih exp (-4 2) dz = y(x).. 


Let X and Y be two i.i.d. N(0, 1) variates. Find the joint p.d.f. of X + Y and X/Y and obtain the 
Marginal p.d.f. of Z= X/Y. 


10, 


ZR. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 
19 


20. 


21. 


22 


23 
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If X and Y are two i.i.d. N(0, o?) variates, show that the p.d.f. of R — Jx KY? is TM 
fin= (г/с?) exp (—r°/207), т > 0. Find the mean and variance of R. L 
X ~ М (0, в?) and Y are independent variates such that P(Y = ~q) = p and Pi aT | 
р + а = 1. Determine p and q in such a way that the moments of Z = X + Y obey the “л, 
E(Z^) = 3 [EZ]. [ 
If X ~ М(и, v), show that 


и, = snin-1) fy Ma-2 dv ро =1, p, = 0. 


If f(x) and $(t) are respectively the p.d.f and Ch. Function of a N(0, 1) variate, verify 
1 со —itx Р 
f» = B b.e * (ft) dt [Inversion Formula 


Let X,, X», ..., X, be i.i.d N(p, o?) variates. Find the joint p.d.f. of U = La X; and V= TAY, iz] 
2, ..., n. Hence or otherwise show that the necessary and sufficient condition that U and V are 
independent is that Ya, b; = 0. 

The frequency distribution f(x) is obtained. from the normal distribution Nt) 


= (42x) exp (—t7/2) by means of the equations 


NICE E {LNW du; і= айп (x-1), x21. 


If exp (1/a?) = 4, find E(X) and Med X. 

Three independent observations X,, X,, X, are given from a univariate N(m, o^). Derive the 
joint sampling distribution of 

(a) U=X, -X;, (b) V=X, -X,, (c) W=X,+X,+X,-3m. 

Deduce the p.d.f. of Z= U/V. Show that Mode Z = 1/2 and obtain the significant of this modal 
value. 

Give a reasonable definition of N(y, o?) if o? =0. 

If X is N(p, o°), find a such that E(X | X 2 а) = k + р, where k is a known constant. 


A variate X has the p.d.f. Дх) = ko(x), x 2 a, ф(х) = (J2n)! e 


where a is a given number, and k is a constant chosen to ensure that ‘f is a p.d. І 
g(a) = ag ф(х) dx, show that the mean and variance of X are respectively 


и= e(ayg(a), o^ = 1+ u(a- y). M 
Let X and Y be i.i.d. standardized variates with common Ch. function o(t). If X + Y and X- ! ^^ 
independent, show that (2f) = [$(0]* (—t), and deduce that X and Y are N(0, 1) variates. 
Let X and Y be independent N(0, 1) variates. Show that the joint m.g.f. of U =X + ; e 
ram * Y'is M(t), t) = (121) exp [t//(1 – 2t,]. Hence or otherwise show that U is à p 
variate and that U and Y are not independent. 
If X and Y are i.i.d. N(O, 1) variates show that 


i te ctrihution 
@ (X+Y)/V2 and (X – Y)/42 are independent normal variates and find their joint distrib? 
(ii) 2 XY and X? — Y? have the same distribution. 


24. 


25. 


26. 


27. 


28. 


29. 


30. 


For logarithmic distributions, 
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Show that if X is conditional N(u, у) and variates U and V have the joint Ch. Function $t, t2), 


then the unconditional Ch. Function of X is (t,, 417) 
$7 1 , 


Let X and Y be t.i.d. МО, 1) variates. If Z = хуу + y J1- V, whereas U(0, 1) distribution, find 
the distribution of Z. 
If X is N(0, 1), find the p.d.f of 1/X?. If X and Y are i.i.d. №0, 1) variates, deduce that 2XY/ 


ух? +Y? is №0, 1). 


(a) If X and Y are i.i.d. №0, o^) variates, show that 
et [y? 4 у? "Д 2 ; istri 
U= xy/ my and y= D - Ani X? +Y? are independently distributed. 


2 s ) —— 2 
(b) If X ~ МО, o, ) and Y ~ N(0, o^) are independent, show that хү/ Joc 4 Y?) is N(0, е) 
where о! = (су). + Che 
Let X, X», ..., X, be 1.1.0. Мр, o?) variates. Let c,, с), .... c, be real constants satisfying Ус, = 1, 
Ус; = 1. Show that Ус; X; has Мү, o?) distribution. Show that no set of values of c's exist, 
which are all positive and satisfy the stated conditions. 
A sequence of random variables (X,) is defined by the c.d.f.'s 


1 1 x 
F w= \ m ЕЕ 1 D(x) + 454 Ф (2) п= 2,3... where (x) is the c.d.f. of N(O, 1) variate. 


Show that each X, is symmetrical about the origin, with variance 2 and that its kurtosis 
coefficient Y, = 2 (n? — 2); increasing monotonically to infinity as n — =. Also show that 


F (x) > Ф(х) as n — c. 

Let X, - N(0, 1) and X, ~ N(1, Ип) be independent variates. If a new variate Y is a result of 
choosing from the values {X,, X,} at random with probability 1 — т! of choosing X, and т! of 
choosing X,, find P{Y < y) and Ch. function $(¢ : Y). Hence deduce that, as n — œ, 


lim $(t : Y, + Y; +...+1,) = exp cir +e" - 1) 
where Y,, Y», ..., Y, is the random sample from the variate Y. 

LOGARITHMIC NORMAL DISTRIBUTION 

we adopt the following way to introduce them : 
X ~ (n (Named distribution) iff (n X ~ (Named distribution). 


16-80. Definition 

A positive random variable X is said to posses a (n-normal distribution if bn X is 
N(u, c?) distributed. Notationally X ~ (n-N (p, в?) with parameter p and с. 

Density. Here Y - N (н, в?) and Y = (n X or X =e". Let Z = (Y - p)/o i.e. №0, 1), г.у. The 
C.d.f. of X is 


Fy(t) = P(X <t}= Plin X < lnt} = PAY <0nt}=P{Z < (nt —p)/o}. 


Thus, Setting 2 = (Un t — uo. 


шан ырын Е 


dz. 


Ft) = [i 
-] 
Fit = f= saz ore T5 


2 


) t»0,f,(0 20, elsewhere 


Moments. р, = E(x’) Ee" ) = M(t: Y) = exp (ш + 1 + а) 
Е(Х) = et +D Е(Х?) = TH às gi +20° ‚ > Var(X) s e?" +o° (e? 1) 

Note. Some authors take (п X ~ М@п б, o`), so that p = (п б, or G = e" and hence 

= б (e" 9 ^) = £* @* , where o = e? ?. In this notation 

o = 6@7(@?-1); p,=Cw?@?-1)? (0+2); pa -C*o*(o* + 20° + 304 — 3) 

= (œ? - 1)? (02+ 2), y, = (o? – 1) (06 + 39* + 60° + 6). 
Since y, > 0, and y, > 3, the distribution is positively skew and letokurtic. 
Example 1. Show that the (n-normal distribution is positively skewed ; i.e 
mean » median » mode. 

Solution. Here f(x) = (2n ox) ! enna wer x>0 NU 
(a) E(x’) T E(e”)= elit + cm [Y Cin» de Мү, c?)] . Thus E(X) = exp (и А. lg?) 


(b) Let m be the median ; then (f(x) dx = |, f(x)dx=+ (Putünx- y) 


[5" (у) dy = f, #0) 4=5 180) =е ое? ‚(э су] 
This proves that the median of Мр, o?) is¢nmso,p=lnm ог m= e. 
(c) Take logarithm of (1) and next differentiate it to get 
(т f(x) = nx- (207)! (nx — н)? +0n(J2n в)! 
gii dr Iu rd 
f(x) X аер 
Differentiating (2) again 


ro [Pe „+ үбах-ю-— 
ie] 


f(x) f(x) x сх 
о) = 0 > х= р-о or x= е" o? AA) 
From (3) and (4) 
F"E) = -(o? 1x3y" «0; so value of х in (4) is the modal value: 


. LI 2 
Obviously : mean > median > mode f., SUI, ^» | 


This proves that the ¢n-normal distribution is positively skewed and leptokurtic- 
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Example 2. If X and Y are two independent бп-погта! variates, then XY and X/Y are 
also ün-normal variates. 

Solution. Let X be ¢n-N (p, с’) and Y be n-N (и', 0°). Let U = XY and V = X/Y. Then 
inU zin X + én Y is the sum of two independent N(y, с ) and Ма, с'“) variates ; it 
follows that U is ¢n-normal with parameters р + p' and в? + 0”. Further, бп V = dn X 
- (n Y ; as before, it follows that V is ¢n-normal with parameters p — p' and o! +0" 
Hence, и > 0, v > 0. 


uc -[U Al o t sai RUN" 
fa) = ees нн) fos V ev| [бп з Р -p )] 


` 2 2 
42x (c +o'") Xo? +o’ lon (c? 4 o?) (ат) | 


Exercise 16(d) 


1. A random variable X has the p.d.f. f(x) = (xJ2x) ! exp [= (nx), x20. 
Find the mean, mode, median, S.D. and coefficient of skewness and arrange them in order of 
magnitude. 


2. Show that if X ~ N(0, 1) is transformed by X = y + 8Un(Y — p), the distribution of Y has 


Mean- Mode _ exp[(28?)"' - exp(-8 ?) 
Mean- Median 7 exp[Q8?)'! - : 
Deduce that this ratio tends to 3 as 8 — ©. 
3. If Án (X - a) is N(p, с ?), find the distribution of x: If y, is the coefficient of skewness for the 
distribution of X and с? = = (п(1 + e ), prove that ө? – 30 y, = 0. 
4. X ~ №0, 1) is transformed to Y by the relation 


X= с По Y -a] with m= e" ^ and p! = и е. 
Show that for the transformed variable D, = m «т +3)-4,В,=т т? +2т+3)-3. 
5. Х15йп-погта1 variate with p.d.f. 


ae 
xip,o) = - ехр _ 270 Eko бы шс 
ox 42n 20° 


Show that e" X? has a n-normal p.d.f. fx; а + bu, Бс "y If X,, ... X, are n independent observations 
on X, then show that = (Х|, X, .... X,) ^ also has a én-normal p. d.f. of ftx, р. o/n). 
6. Let X, Y, Z be i.i.d UÜn-N(4, 0.9) variates and let V = XYZ. Let Ф(х) is to be p.d.f. of N(0, 1) variate. 


Find the numbers a, b, c such that 
P{V<e'} = Ф(—1), PIV se^) -05, Р(У se^) = Ф(1). 
7, La X Y, Z be i.i.d. (n-N(2, 0.9) variates, and let V= XYZ. Prove that P(X > e, Ү>е? 2>е >) 


< P{V < ef} and evaluate both sides. Also find P(V < e Py 
8. The variate X has mean m and S.D. ‘s’ and Y z (п, X ~ N(M, - ). Show that 


mz exp(M +457), 1+ (s? /m) exp (5°). 
9. Given that X; ~ (п №р,, 6; Зу, iz 1, 2: , n are independent, find E (Y^ where Y= [| (a; . X;). 
10. Find the 5th percentile of n Мур, с ^ у р = 5.140, с = 0.74. 


There is no grief which time does not lessen and soften. (Cicero) 


Always forgive your enemies; nothing annoys them so much. 
(Oscar Wilde) 


Appendix : Additional 
Applied Problems on N(p, 6 f) 


We include some worked-out problems followed by some exercises оп N(y, o^ 
population. 

Example 1. In a distribution, exactly normal, 7% of the items are under 35 and 89% 
are under 63. What are the mean and S.D. of the distribution ? 


X639 X289 
=-2; 24 = 2; 


Solution. If X ~ N(y, с?) is the population, setting Z = (X — p)/o we get 
0.07 = P(X <35) = P{Z < (35-1)/6);0.89 = Р(Х < 63) = P(Z < (63 – u)/o] 


w(z,) = 0.43, w(z,)= 0.39, д = (35 - p) 16, 2; 2(63—1)/6 
Thus, z, = 1.48, 2, = 1.23 so that 63 — р = (1.23) c, р – 35 = (1.48)с. 
Adding these Eqs. a LO TUER — 28/2171. 28 x.0.369 = 10.332. 

= 35 + (1.48) (10.332) = 35 + 1529136 = 50.29. 

ehe 2. If skulls are NEA as A, B, C according as the length-breadth index i5 
under 75, between 75 and 80, over 80; find approximately (assuming normality) the 
mean and S.D. of a series in which A are 58%, B are 38% and C are 4%, it being given 
that w(0.20) = 0.08, w(1.75) = 0.46. 


Solution. 1f X denotes the length-breadth index of skulls then we are given that ^ 
P(A) 20.58, A = (X 2 75) ; P(B) = 0.38, В = {75 < X < 80) ; P(C) = 0.04, C = (x28 
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Let X ~ N (p, с); and put Z = (X ~ р)/с i.e. X = p + oZ. It is obvious that the areas give 
Pius X€75) = Р[0<25< (750) /с] = v [(75 - p)/ o] = 0.08 
Р(р < X < 80) 


Р[0 < Z < (80 – р) / 0] = v [(80 – р) /с] = 0.46 
y[75-pu)/o] = 0.08 = (75 – р) = 75 – р = (020) с 
[080 – р) /с] = 046 = (80- р)/с=175 = 80- p = (175) с 
Subtraction provides 1.55 с = 5 — с = 100/31 = 3.226 
H4 M = 75 – (0.20) (3.226) = 75 – 0.6452 = 74.355. 
Example 3. This table gives frequencies f of occurrence of a variable X between certain 
limits : 
f(X< 40) = 30, f(40€ X «50) = 33, f(X > 50) = 37. 


The distribution is exactly normal. Find the distribution and also obtain the frequencies 
between x = 50 and x = 60. 


Solution. Here >f = 100 ; so we are given, from N(p, o^) the data 
Р(Х <40) = 03, P(40 < X x50) 2033, P(X > 50) = 037. 
Put Z = (X — p)/o, so z, = (40 - p)/o, z, = (50- џ)/с. The data reads 


2 = -0.52 2, = 0.33 
P(Z<z) = 03P(a4«Z2«27)- 0.33, P(Z > z,) = 0.37. 
From w(z) = 0.20, z; = -0.52 From w(z,) = 013002, = -0,33, 


50 — р = 0(0.33) and 40 - p = – 6(50) = 0.850 =10 — с=1176 [Ву Subtraction] 
Also р = 50 — с(0.33) = 50 388 = 46.12. Thus, the distribution is N(46.12, 1 1.767). Further 


p= P(50« X <60) = P(0.33< Z «118) = y (118) - (0.33) = 0.3810 — 0.1293 = 0.2517. 


The frequencies between X = 50 and X = 60 аге 25.17, i.e. 25. 

Example 4. A certain examination was taken by 1000 students, who are to be classified 
into subgroups A, B, C, D, E according to ability, range of ability to be equal in the 
Subgroups. On the assumption that the trait measured is normally distributed, how 
many students should be placed in each group, given that y(0.6) = 0.225, w(1.8) 
70.463, y(3.0) = 0.499. 

[y(k) is the area under N(0, 1) curve from x = 0 to x = k] 

Solution. Almost entire range of N(u, o?) is from p - 3o to p + 3o, it follows that the 
tota] range is (р + 30) - (p - 30) = бо. This range is to be divided into five equal 
Subgroups are 
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(и — 3с, р — 1.80), (u — 1.80, н — 0.60), (и – 0.60, p + 0.60), (p + 0.66, и + 1.86), (u+ 1.86 ^ 


Or measured in standard units (и = 0, o = 1), these are 
(-3, -1.8), (-1.8, –0.6), (-0.6, 0.6), (0.6, 1.8), (1.8, 3) 


If fla, b) denotes the frequency of group in the range (a, b), then, 
f [1.8, 3] = 1000 x [y(3) – v(1.8)] = 1000 (0.499 — 0.463) = 36 
f [0.6, 1.8] = 1000 [u (18) — y (0.6)] = 463 - 225 = 238; 
f [-0.6, 0.6] 1000 [w(0.6) + y (0.61)] = 450. 

Thus, the number of students in the groups аге 36, 238, 450, 238, 36 and these figu 
total to 998. The rest of the two students can be put into the extreme groups (из, 
y — 1.8 c) and (u + 1.86 , u+ Зс) because these intervals are open. We can thus kee 
37, 238, 450, 238, 37 students into the group A, B, C, D, E respectively. 


Problems with Solutions Provided at the End of the Text 


1*. Suppose diameters of shafts are normally distributed with mean 10 cm and S. 
0.1 cm. If the shaft must meet the specification that its diameter fall between 99 
and 10.2 cm, what proportion of shafts will meet specification ? 

2*. A manufacturer making beds finds that the average height of men is 1 m. 72 cm with 
a S.D. of 8.5 cm. What length (to the nearest cm) must this firm make its beds, in order 
that no more than 5% of men, find themselves too long for the beds manufactured ? 

3*. Assuming the mean height of soldiers to be 68.22 inches, variance 10.8 (inches), 
find how many soldiers іп a regiment of 1000 would you expect to be over 6 feet tall 
[Given : area under N(0, 1) curve between z = 0 and z = 0.35 is 0.1368 and 
between z = 0 and 2 = 1.15, it is 0.3746]. 

4*. In N(I15, 3,33 population, it is known that 647 observations exceed 16.25. Whal 
is the total number of observations in the population ? 

5*. The S.D. of a certain group of 1000 high school grades was 11% and their mea! 
grade 78%. Assuming the distribution to be normal find (i) how many grades 
were above 90%, (ii) what was the highest grade of the lowest 10, (iii) what w® 
the semi-interquartile range and (iv) within what limit did the middle 900 lie 

6*. One thousand candidates in an examination were grouped into three classe 2 
and III in descending order of merit. The number in the first two classes wer? а 

and 350 respectively. The highest and lowest marks in class П were 60 and Р 

respectively. Assuming normal distribution, find the average, S.D. and the numb? 

of candidates obtaining marks between 43 and 53. Areas under N(0, 1) curve p 


2045) 
w(02) = 0.079, у(03) = 0.118, w(0.4) = 0.155; y (15) = 0.433, y(16) = 0.445, y0 =" 


p. 


8*. 
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The marks obtained by a number of students for a certain subject are assumed to 
be approximately normally distributed with mean 65.2 and a S.D of 5. If 5 students 


are taken at random from this set, what is the probability that 3 of them will have 
marks over 75 ? 


Women's shoes are manufactured in sizes 2, 3, 4, ..., 8 ; the length advancing in 
steps by 1/4 in. Size 5 is suitable for a foot of length ranging from 92 inch to 94 


inch. If the length of women's feet are normally distributed with mean 9.4 inch and 
S.D. 0.25 in., how many pairs of shoes of each size will be required, out of every 10,000 


pairs manufactured ? [Assume that all women with feet less than 82 in length will be 


content with size 2 and women requiring a size larger than 8 are not catered for]. 


Exercises 


. (a) Ina normal distribution, 31% of the items are under 45 and 8% are over 64. Find the mean 


and S.D. of the distribution. [Ans. 49.96, 9.995] 


(b) Of a large group of men, 5% are under 60" in height and 40% are between 60" and 65”. 
Assuming a normal distribution, show that the mean height is 65.5 and S.D. is 3.3". 


. The width of a slot on a forging is N(0,9", [0.004")?]. The specifications are 0.900 + 0.005 


inch. What percentage of forgings will be defective ? 


. Given that X is normally distributed with mean 10, and P(X > 12) = 0.1587. Show that the 


probability that X € (9, 11) is 0.3830. You may use ®(1) = 0.8413 and @(—+) = 0.3085. 


. A dealer sells an item for Re 1. If the weight W ~ M(u, 1) of the item is less than wp, it is dead 


loss. The cost c per item is c = a + bW, (a > 0, b > 0). Determine p so that expected profit is 
maximum (и > wọ). 


. À minimum height is to be prescribed for eligibility to Government service such that 6096 of 


the young men will have a fair chance of coming upto that standard. The heights of youngmen 
are normally distributed with mean 60.6" and S.D. 2.55". Show that the minimum specification 
is 59.96". 


. The time when a country bus passes a certain point is distributed normally with a mean 9.25 


A.M. and a S.D. of 3 min. What is the least time one could arrive at this point and still have a 
probability of 0.99 of catching the bus ? 


- Torch batteries of a certain make have an average life of 50 hrs with a S.D. of 3 hrs. How many 


batteries in an order of 1000 may be expected to last (a) longer than 55 hrs, (b) less than 
44 hrs ? Find approximately within what time 30% of the batteries may be expected to fail. 


[Ans. 48, 23 ; time : 47.45 hours] 


- Five thousand candidates appeared іп a certain examination paper carrying a maximum of 


100 marks. It was found that the marks were distributed as N[39.5, (12.5)]. Determine 
approximately the number of candidates who secured a first class for which a minimum of 60 
marks is necessary. You may use the following table : 

Z- 1.5, 1.6, 1.7, 1.8 Corresponding A = 0.9332, 0.9452, 0.9554, 0.9641 


Here A is the proportion of the whole area of the normal curve lying to the left of the ordinate 
at z. [Ans. 272] 


- Inan examination it is laid down that a student passes if he secures 30% or more marks. He is 


Placed in the first, second or third division according as he secures 60% or more, between 
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11. 


12. 


13. 


14. 


15. 


16. 


27. 
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and 45% marks respectively. He gets a distinction in os 


rved from the results that 10% of the students fails ;- 


ic 


45% and 60% and between 30% 


secures 80% or more marks. It is obse ne resu | 
the examination, whereas 5% of them obtained distinction. Show that the percentage o, 


students placed in the second division is 34%. Assume normal distribution of marks. 
In a University examination of a particular year, 60% of the students failed when mean 
and S.D. 5%. What were the minimum pass marks ? University decided E 
pass marks to show its result 70%. Find tha 
he marks to the normally distributed ang № 


marks was 50% 
relax the conditions of passing by lowering the 
minimum marks for a student to pass, supposing t 
change in the performance of students takes place. [Ans. 47,38 
The average percentage of marks of candidates in an examination is 42 with a S.D. of 10. The 
minimum for a pass is 50% and if 1000 candidates appear for the examination, how many can 
be expected to pass assuming that marks are distributed normally ? If it is required that 
double that number should pass, what should be the average percentage of pass marks ? 

A certain number of articles manufactured in one batch were classified into three categories 
according to a particular characteristic being less than 50, between 50 and 60, or greater than 
60. If this particular characteristic is known to be normally distributed, determine the mean 
and S.D. for this batch if 60%, 35% and 50% were found in these categories. Given that if erf 
(0.25) = 0.1 and erf (1.66) = 0.15). 

Marks obtained in Statistics in a certain examination are found to be normally distributed. If 
12.596 of the candidates obtain 6096 or more marks, 3046 obtain less than 30 marks, find the 
mean number of marks obtained by the candidates ®(z) is the c.d.f. of МОО, 1). 


Z : 0.27 0.28 0.29 1.14. 115 1.16 
D(z) : 0.6064 0.6102 0.6104 0.8727 0.8749 0.8770 
The mean I.Q. (intelligence quotient) of a group of 225 children is 102 and S.D. is 15 with 


reliability (of the test) 0.91. 

(i) What proportion of this group is expected to have I.Q's greater than 132 ? 

(ii) How often will the mean I.Q.’s of the group fall as low as 100 ? What is the probability 
that the mean I.Q. of the group is above 100 ? 

A nurse lives at A and works at C. She starts work at 8 a.m. She always uses train from A (0 B 
which generally reaches B at 7 : 40 a.m. Buses from B leave for C every 15 minutes and the 
bus that leaves at 7 : 45 a.m. generally arrives C at 7 : 56 a.m. The train on average gets delays 
of 2 minutes and has a S.D. 4 minutes. The bus always leaves on time, but reaches C, on average 
after a 2-minute delay and a S.D. of 3 minutes. Show that P {Nurse arrives late) = 0.40. The doct? 
(nurse's employer) drives to C, he leaves at 7 : 45 a.m. and driving time to C is №12, 2’) in 
minutes. Show that 

P (Nurse and doctor both arrive late} = 0.028. 

P (Doctor arrives earlier than the nurse} = 0.61. 


In а certain examination, the percentage of passes and distinctions were 45 and 9 respectively: 
Estimate the average marks obtained by the candidates, the minimum pass and distinction 
marks being 40 and 74 respectively. Assume the distribution of marks to be normal. АБО 
determine what would have been the minimum of qualifying marks for admission t° EDU 
examination of the failed candidates, had it been desired that the best 2596 of them sho" E 
given another opportunity of being examined. 

metri Sockets are manufactured by independent machines. Let P and S denote the diameter" 
n millimeters of a plug and a socket respectively. Socket fits well to the plug if $ is in’ 


18. 


19. 


20. 


21. 


22. 


23 


25, 
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range (P * 0.2, P + 0.4). Assume that P is N(1, 0.001) and 5 is N(1.3, 0.0015). What percentage 
of plugs and sockets fit well ? 


(a) Marks secured by students in sections A and B of a class are independently normally 
distributed with means 50 and 60 respectively and variances 10 and 6 respectively. What is 
the probability that a randomly chosen student from section A scores more than a randomly 
chosen student from section B ? What percentage of students are expected to secure first 
division. (i.e. 60 marks or more) in section A ? Write down your results in terms of the standard 
normal c.d.f. Ф(2). 

(b) Articles are being manufactured with a dimension whose mean value is 2.522 in. with 
S.D. 0.005 in. Tolerance limits are 2.510 in. and 2.530 in. Find what percentage of articles will 
fail to meet the tolerances if the distribution is normal. 

Steel rods are manufactured to be 3 inches in diameter but they are acceptable if they are 
inside the limits 2.99 inches and 3.01 inches. It is observed that about 5% are rejected over- 
size and 5% are rejected under-size. Assuming the diameters are normally distributed, show 
that S.D. of the distribution is 1/165. Hence calculate what proportions of rejects would be if 
the permissible limits were widened to 2.985 and 3.015 inches. [Ans. 1.34%] 
A company uses many thousands of electric lamps annually burning day and night. Assume 
that under such conditions the life of a lamp may be regarded as N[50 days, (19) days]. On 
January 1, 1972, the company put 5000 new lamps into service. How many expected to be 
replaced by (i) February 1, (ii) April 1 ? The lamps are put into operation at about the same 
time of the day. 

In an examination, the mean and S.D. of marks in 
mathematics and chemistry are shown in the 
adjoining table. Assuming the marks in two subjects 
to be independent normal variates, show that the 
probability that a student scores total marks lying 
between 100 and 130 is 0.3635. [Full marks in each 


J wean [SD 
subject are 100]. Given that erf (0.28) = 0.103, 


Maths 45 10 
Chem. 50 15 
erf(1.94) = 0.4738. [erf (z) = y(z)-] 


Two pieces AB and CD are assembled together in a mass production, assembly. Lengths AB 
and CD are normally distributed. The average length of CD is 2.5 inches with S.D. of 0.13 
inches. Both dimensions are normally distributed and the assembly is at random. Find the 
approximate probability the assembly will have a combined length of 6.05 inches or more. 
Screws are rejected if the length is less than 0, and greater than 0,. From a batch of 128 screws 
produced by a certain machine 28 were found to be less than 0, in length and 8 were longer 
than &. Assuming the lengths to be approximately normally distributed, estimate the mean 
length and S.D. of the screws. Can you estimate the average length of screws which are 
accepted ? У 


· In acertain human population, head index i is assumed to be normally distributed. There are 


58% dolichocephatics (i < 75), 38% mesocephatics (75 <i < 80) and 4% brachycephatics 
ü > 80). Find the mean and S.D. of i. If F is the standard cumulative normal distribution, then 
itis known that F(0.202) = 0.58, F(1.75) = 0.95. 

A manufacturing company produces rods. It is desired to have the length of a rod 4 cms, but 
infact the length has normal distribution with mean = 4.01 cms and S.D. = 0.03 cms. Each rod 
Costs 12 paise to make and may be used immediately if its length lies between 3.98 cms and 
4.02 cms. If the length of the rod is less than 3.98 cms, the rod is useless but has the scrap 
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value of 3 paise. If its length exceeds 4.02 cms, it may be shortened and used at а furthe 
of 4 paise. Find the cost per usable rod. 

The mean yield for one-acre plot is 662 kilos with a S.D. 32 kilos. Assuming normal distrip 
how many one-acre plots in a batch of 1000 plots would you expect to have yield (i) у, 
kilos, (ii) below 650 kilos, (iii) what is the lowest yield of the best 100 plots ? 

The local authorities in a certain city install 10,000 electric lamps in the streets of the city. | 
these lamps have an average life of 1000 burning hours with a S.D. of 200 hours, assum | 
normality, how many lamps might be expected to fail (i) in the first 800 burning hours 9 
(ii) between 800 and 1200 burning hours ? After what period of burning hours would you 
expect that (a) 10% of the lamps would fail ? (b) 10% of the lamps would be still burning » 
[In N(0, 1), w(1) = 0.34134 and 80% area falls between the limits z = + 1.28]. і 


The local authorities in a certain city installed 2000 lamps in the streets of the city. The lamps 
have an average life of 1000 burning hours with a S.D. of 200 hours. 

(a) How many lamps might be expected to fail in the first 700 burning hours ? 

(b) After what periods of burning hours would we expect that 

(i) 10% of the lamps would have failed ? (ii) 10% of the lamps would be still burning ? 
Assume that the lives of the lamps are normally distributed. Given (1.50) = 0.933, (1.28) = 
0.900. 

An establishment uses 1000 bulbs which are kept burning approximately 4 hours everyday. 
Past experience of cost incurred in replacing burnt-out bulbs has shown that it is profitable to 
replace all the 1000 bulbs, whether some of them are burnt out or not, in 4 months (about |20 
days). Bulbs burning out during this period are not replaced till the end, inconvenience 
regretted. Assuming the life in days of a bulb is normally distributed N(450, 30°), find the 
expected number of hours for which a bulb is dead at any point during the four month period. 
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A few observations and much reasoning lead to error, many ' 
observations and a little reasoning lead to truth. [Alexis Carrol] 
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We know a thing when we understand it. (George Berkeley) 


Central Limit Theorem. 
Normal Approximations 


Notation. Let X, Хз, ..., X, be iid random variables from a distribution (population) 
which has a finite mean р( = E(X) and variance o? and any proabability law. We record 
this statement simply as 

(X, Xo, o Xn) Eu ll, o?) 
Of course, when the p.d.f. (or p.m.f.) of the distribution is known, we modify the 
notation, as usual and specify the parameters as well. For example, 


X,- bin (n, p), X; ~ М(н, o^), X, ~ gam (a, A), ... 


17-10. Definition of Central Limit Theorem (C.L.T.) 


A sequence of jointly distributed random variables Х|, X», ..., X, with finite means and 
variances, 0 « Var (X) < o, is said to obey the central limit theorem (CLT) iff the 
standardized Sum 57. 


S* = 5, —E(S,) 
а с(5,) 
Remark. By Levy's Continuity Theorem, {Х,} obeys С.г, 

M(it : S*) — exp (-1°/2), as n > co. 
Note. Consider independent X;'s, each with mean p and variance c^. Then 


converges in distribution to №0, 1)-variate. [s => X= | 
і= 1 


S [Standardized sample sum or mean] 
7 суп с/ Уп 


17-11. Lindeberg-Levy C.L.T. 


Let X,, X,, ..., X, be i.i.d. variates, with mean р and variance с^, 0 < o? < œ. Let 


ME 


Fx) = P(S} <x), Da) = 7 |, ex (-5 Ja 
T 
Then F (x) > Ф(х) as n — œ for all x € R. 


они : | [Р(5 <z)- Ф(2)| =| [P(X; < 2) – Ф(2)| <Е. 
roof. Firstly we observe that 


S.-E(S) S,-mp_ 1 X) 12 

se = —L B LN HET C і i hm Y, 

а с(5,) суп Vn > o Vn > 

à Y, = [(X; – р)с], are i.i.d standardized variates with E(Y,) = 0, Var (Y) = 1. The 
SF. of S* is given by 
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M(t: 5%) = Mi: CEY)/ n] = Ми! vn: E n. 


Now Taylor's series for КАЙС ) 15 


' e (t' / r , € m п) у (t1 4n). 22+ ir) и, . 
M(t ) = «di v M' (0) = КЕ i e ае. o? T M (o; » ! и f) 
r=0 . 


"ү? = i £y 
[M(r’)] -[++о{® 


2 2 п 2 
So lim M(r:$;) = lim ez vage =ехр (a) (by Euler’s limit Theorem) 


As e" is the m.g.f of №0, 1) distribution, it follows by Levy's Continuity Theorem 
that S* — N(0, 1) in distribution. Equivalently, X, — №0, 1) in distribution. 

In other words (X,) follows C.L.T. Further, since P(x) is continuous c.d.f. so by Polya’s 
theorem, F(x) — P(x) uniformly V x € R. 


Cor, Let дон А, 0S i.d. Standardized variates such that n ja S, has the same 
distribution, V n = ki 2. . Then, the distribution of X; must be N(0, 1). 


M лы N 


Proof. 5, = тора RIT S [F, (x) = c.d.f of 5, ] 
lim ota. dug P(S,/ Уп < =) iby C,L.T] 


Since (S, / n) has the same distribution for all л, we must have Р S <x} = 
for each n. It follows that we must have F(x) = dx), i.e. X; ~ №0, 1) for each n. 
17-12. De-Moivre's Laplace C.L.T. 


Let X,, X,, ..., X, be iid. Bernoulli random variables with common probability p of 
success. If X = X, + X, +... + X, (= S,), then 


> X —np 
lim P € x» = Q(x). 
n>n | Inpq | (x) 
Proof. Here Е(Х,) = р, EQ) = p, Var(X;)= E(x?) -E (X;) = pq, so E(S,) = np, Var S, = 1р0: 
Hence by Lindeberg-Levy C.L.T. 


= -E(S,) 
Фл) = lim PIS; <n= im P* РА i-es 
no пра ols.) J 


This completes the proof. Consult also §17-51. 


17-13. Stirling’s Approximation 


For large values of n, пі ға Jane" nt, 
Proof. Let X,, X, ... X, be i.i.d. Pois (1) variates. Then S, = X, € X; +... + X, is Ро! e 
by Addition Theorem. Here E(S,) Se Ver cs y Consequently, (1) 


P{S,=n}=e"n"/n! 


o L Stirling’s Approximation 5 2 4 
We evaluate P{S, = n} by C.L.T. 
as well. Now. 


P(S, = п) 


as Well, Ав 5 is discrete. w | 
Р ell. As 5, is discrete, we apply continuity correction 


H 


b A 2 
Pin EASA SA L} 


= pie 1/2)-n < S, аж. < (л T 1/2) -n 
Уп Уп Jn 


1 * 1 
= P:-—= <S <— 
| 2 Jn n zz. 
By C.L.T., S; =Z ~ М (0, 1), hence 


Уһ 
P{S, =n} = 2f, ~" f(z) dz - 2x Area of Rect. ОАВСЇ 


( ÍT | (2) Beatty o ep 


adh Jon f(0) 2 1/ J2x 


= 1/J/2nn 


Equating (1) and (2) gives 
e"n"/n! = 1/42nn 
This gives n!z 2x e" .n^* 0? 
Example 1. Let Х|, X,, ..., X, be a sequence of independent Bernoulli variates : 
Р(Х,= 1) = р, Р(Х, =0) =9, p+q=1, Let X - (ZX))/n, 1<i<n. 
Verify C.L.T. by showing that X tends to be normal as n — oo. 
Solution. (EX) = 1р+0.4=р. E(X2) = V.p* 0*.4- p, so Var(X,) =Е(Х2) -E (X) = p— p? = pq. 


| GTA 
~1/2Vn 1/2Nn 


E(X) = [ZE(X,)]/ n = np/ n, Var(X) = (1/ n^) [E Var (X,)] =npq/n? = pq! n — o? (say). 
M(t: X) = Еке) = ре +q; M(t:X)=M(t/n:5X,)= [М(ї/п: X)" = [4 + pe". ...(1) 
As per C.L.T. X* = (X — p)/ Jpqin is approximately Normal if n is large. To verify it, 

M(t: X*) = M[t;(X-p)/o]=e?"°M[t/o):X]=e [q+ ре". 


2 n 
uA t 
(pee qe) Ji Zo ) 


Ш 


2 ! р? i XT v yg 
lim мазх?) tim] 1+ tO] =e 
This Shows that the asymptotic distribution of X* is N(0, 1) 


T Area of infinitesimal rectangle amounts to Taylor's approximation to the function f(z). 


т 
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JCO 3) Á Á  CentralLimt theorem orm — 
"^n. yr = [1+ (pt / n) + О(1/ п)". As n> œ, M(t: X) =e! 


Note. M(t : X) = [1+ ple 


(m.g.f. of a degenerate r.v.). However, X is not degenerate since Var X = 0 
Example 2. Prove the C.L.T. for a sequence of independent variates (Х,) having ч 


distribution (i) U(—a, a). (ii) Expo (A). 

Solution. (1) Here Е(Х.) = (a—a)/2=0, Var X; = (b — а)? /12=a’ / 3. Let S, 
Then E(S,) = 0, B, = Var (S,) = n Var (X) = na‘/3 so S* = (S, – 0) V3/avn. Now 
M(t: S*) = M(t: N35, Lan) = M(V3t/aVn: S,)=(M(v3 t / avn: X;)]" 


at =at 1 
iX, E ga PR „зы ШАШ sinh at 
Ее ')= ies "das um 5 at — 


1 sinh (2/3 / n) of) à 
M(t: $,) = ш Jin s ER m (+) 


So lim M(t: S,) = lim 1+2 +01) =e"? = [m.g.f. N(0,1)] by Euler's limit, 


TNNT. 


Since M(t: X;) 


2n 
(ii) X ~ Expo (A) has E(X) = 1/A, Var(X) = 1/27, M(t) = (1 – t/A) |. Now let $, = X, +... «X. 
Then E(S,)=n/A, Var (S,) = n/X, S* = (S, — (Ana). 


M(t : S*) = Mr ^J а) =e (ss, n L (x) г К эй] 

. in M(t: S*) = —/пт—п1ор(1—/./л)=—упт+п[/-/п +1” /2п+О(1\/ nj] 2 £ 12 - OV Vn) 
lim log М @:5„) = ° /2=> lim M(t: S*)=e' ? =m.g.f.of N(0,1). 

Conclusion. The limiting distribution of S* is N(0, 1) which proves the C.L.T. 


Method of Approximations by C.L.T. 
1. Construct S* = [5, -E(S, )]/ J Var (S,) , Where S, - X, * X, "uw X,. 
2. For large n, treat S*, as Z ~ N(0, 1), Notate Ф(7) = c.d.f. of N(0, 1) 


Two Illustrations : 
(i) Let X ~ bin (n, p) Treat X = X, +... + X, where X, ~ Ber (p) so that 


$,* = (X-np)! пра 
P(Xxx) = PIS; <(x-np)/ Упра) = Ф (x – пр) / Jnpql 
A slightly improved result follows by using continuity correction : 


P{X<x} = O[(x+0.5—np/Jnpq). 
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(ii) Let X ~ Pois (A); Treat X = X, + Х +... + Х where X; ~ Pois (A/n). 


sn E 
P{Xsx} = P(S. <(x- 29/ VA} ж Ф [(х — 5) / VA] 


Use Continuity correction to improve this approximation : 
PiXSx} = O[(x+05-A)/ Jx]. 


17-20. The Lindeberg-Feller C.L.T. 


Let X, X», — X, be independent non-degenerate variates with distribution functions 
ЁР. F, means у, Wy, ..., р, and finite variates 02, 02,.., 07; respectively. Let 


B, = Var (S,) = Var (X, +...+ X,)=07 * 02 4... o2. 
If F, are M continuous with p.d.f. ‘f? and if the Lindberg-Feller (L-F) condition 


lim — PANG Y f(x) dx =0, (A, =1X —pjl>e B,) 


nw В 


holds for all € > 0. then 


noo noo n 


lim P(S; <a} = lim P | E < al = (a) = c.d.f. of N(0, 1). 


Proof is omitted. 
17-21. Lyapounov’s C.L.T. 
Let X,, ..., X, be independent variates with E(X;) = р, and Var (X;) = с? and B? =0? +..+с2. 


If a positive number ô can be found such that 


lim B, ^*? УЭ E(IX, - njP**) = lim тү [Lyapounov Condition] ...(1) 


no iud >% (B, one 
S, - E(S,) 
B 


n 


then lim P(S; <a} = lim Yil 4 = Ф(а) = c.d.f. of №0, 1). 

Proof. We check that Lyapounov condition implies that Lindberg-Feller condition is 

Satisfied. So consider L-F condition §17-20. $ 
2+8 


волов = 1 7 Ej Лоа 


вуз + 
< (eB ux Га, mP? р(х) ах [7 Ix- pl» В, on A} 


—(2+5) „ 
< eir ар, 60) dx, E A, c Ry] 


(К... Де 
(RP а 2+5 Ьу (1 
= ho ^a Е p,P**)— 0, as п ә оо, [by (1)] 
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Hence Lindberg-Feller condition is satisfied and so C.L.T. holds. 


Note. In numerical problems, we may take 8 = 1.Thus for C.L.T to hold 


lim (у; (B,)'] -0,asn- o 
Lyapounov Bound. Let №, = Vj,s 1В2*°. Then 


IP(S; < г) - 9(0] < 0.8 A,. [8 = 1 suffices) | 
This bound is too general to provide sharp results for specific cases : A, > 0 is Lyapuo; 


condition. 
EL Arm и м. 


————— А 
Xj УХ 


Remarks. The essence of C.L.T is that repeated samples of size n, even from а non. 
normal population, generate an approximately normal Havers of either sums or 
means as indicated in the above figures. All samples x,, x5, ..., x, from a non- normal 
population X; which is far from being symmetric, generate an B esos! normal 
population of Y-sums X; 

Normal approximation. ‘het E(X) = p and Var (X) = с>. By the normal approximation 
to X, we mean the approximation Fy(t) = ®[(t — и)/с]. 


17-30. Theorem 


Let Zi Zy iy 5, Ue i.i.d variates with E(Z) = p # 0 and Var (2) =o" #0. 1fS,=Z, +. 
then P{a < 5, < b) — 0, as n — ©, where a and b are any two real numbers, with ү. > а 


Proof. Let S* = [S, – E(S,)]/o(S,) = (S, $ —np)/oVn, so that 5, =np + ovn 5,. Thus 
ipit. = (a « ny. 6 nS, « b) = (A, « S, < В,), mi) 


where = (a '_w)Jn/o, В, = (Рп! — р) Уп /с. 
Case 1. р = 0. Lete> 0 be an arbitrary number; choose a positive number so that 


"Pia 3 
Now choose a positive integer Y so care К: > -h, В, < h whenever n > №. JU 
Choose a positive integer N, so that 


IP(-h < 5* «h) - Hi«ie, for n» №, 


The C.L.T. assures us that we can find such a positive integer N,. Now 
where № = max (N,, N,}. From (1) and (3) it follows that (a « $, « b) = ( 
c (-h«S*«h). 


Thus Р(а<5, <b)<P(-h<S, «h) -H «ie« jet $e-e, 


(4) 


suppose " ? 
А, < S * < p) 


by (2) ifn?’ 
11) 
[e is arbitrarily sma 


lim P(a < S; <b) = 
s h such P 


Case 2. Let p > 0. Let 6 > 0 be an arbitrary number. Choose a negative numbe 


ж e du B 


H.E x А 


„(5 
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since lim A,  —9. lim B, — —o, we can choose a positive integer m, such that 
A, «-h, В, < -h, forn»m, (6) 
Using C.L.T. we can choose a positive integer m, such that 
IP(S*«-h)-H,I« 16, for n» m,. 2d 0) 
From (1) and (6) we conclude that 
(a « S,« b] = (A, «S; « B)c (S, «-h) 
Р(а < S, <Б) < P(S? «-h)«H, +16<15 +10 = [by (7) апа by (5)] 


This amounts to : lim P(a < 5, <b) = 0, as n > © when p > 0 [6 is arbitrary small]. The 


case p < O is similar. 


Cor. Pla« S, «b, Vk) 20. [ier ес, ыо) ...(8) 


k=l 
Proof. If n is any particular positive integer, then surely 
(a« S, «b, Vk) c (a« $,«b) > Pla<S,<b,V k) sPla<S,<)}. ‚..(9) 
The relation (9) is true for each positive integer n. The R.H.S. of (9) approaches O as 


n — o (Theorem 17-30) while the L.H.S. is independent of n. Thus, the L.H.S. is a non- 
negative number smaller than every positive number and hence it must be zero. So (8) holds 


17-31. Summary of Selected Results for C.L.T. 
Let {X,, n > 1) be a sequence of independent variates defined on some probability 
space. Denote : 


$,2 X * X, p, =E(X,), 0; = Var(X,), B; = Var($,) = с TEO u's,). 


The sequence (X,) satisfies оа тине 
lim PIS. <x} = Ф(х) = [c.d.f. of №0, 1)]. $ = Su EG 
n o & o(S,) 
Let F, denote the c.d.f. of X, and assume that E(X,) = 0 for all n 2 1. We record the 
following three conditions. 
(L). Lindberg Condition : lim È ¥ (wd F,(u)=0, for each e» 0. A = (lul z e B,]. 


n>% B? kzi 


2 
(F). Feller Condition : lim max (5 )-о 


n>olsksn B, 


(UAN). UAN Condition : lim max P(1X,/ В, 12е} =0. 


olsksn 
[U.A.N. = Uniform asymptotic negligibility] 
Two fundamental Theorems are : 
Lindberg Theorem : (L) => (C.L.T.) 
Lindberg-Feller Theorem : ((L) <= (C.L.T.) & (F)} or ((L) < (C.L.T.) & (U.A.N.)} 
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17-32. Some Theoretical Problems Worked-out 
Example 1. Let Х|, Х,, ..., X, be independent bin (n, pj), 1 < i < k variates. Jf , 

за ‚ and 
are large enough, show that nai 


n k k 
Y IX, -npl ~ Je У а. (1-2) Уп, pa) 
i i=] і = | 
Solution. If X is МО, o°), then Y = | X |, called folded normal variate, has 
E(Y) = o/42/n, Уаг(у)=с°.[1-(2/л)]. 
Now, let Y, = | X, — n, p,|. For large n, 


mM 


(X; -nip) ~ N(0,0;); о? =n, piq: ( 
S, Y, *Y,-..-Y,; E(S)-(Zo)42/m,  Var(S,)- [1-2/2] (20?) 
where we have used (1), the folded normal values. 
By C.L.T., [$, -E(S,)]/o5, ~ N(0, 1) 
This means, S, ~ N[E(S,), Var(S,)] ...(3) 


This is, in essence, the result sought. 


Example 2. Let X ~ Cauchy (0, Б) and Х|, X», ..., X, be a random sample of X. 
Let Y, = (X, + X, +... + X,)/n. Find the p.d.f. of Y,. Does the C.L.T. hold for Y, ? 


Solution. (i) We know that the p.d.f. and Ch. Function of X are 


fix) = Med — oo « X « oo, фе" (1) 
o(t=Y,) = o(t/n:X,+...+X,)=[o(t/n: X) pial aT ld 
This shows that Y, has the same p.d.f. as X, i.e. [1a] 
(ii) Since ф(7, Y,) is independent of n and so is its p.d.f., it follows that Y, does not tend to 
a normal r.v. as n — ©. Consequently, the C.L.T. does not hold in the Cauchy distribution. 


Note. Since m.g.f. for Chy (0, b) does not exist, we are to use Ch. Function. 
Example 3. Examine if C.L.T. holds for the following sequences of indep. vari 
(a) P{X, - 42") " tio d» P(X, =0}=1-274 

(b) Р(Х, =+к%} = 107%, P(X, 20) -1- ^"^, a <. 


im 
Solution. For the non i.i.d. variates, for C.L.T. to hold, we must have s 
MA 


ates. 


À, = lim(v,/ B2) 2 0, as n — ©. [Lyapounov's Condition] 
(a) E(X,) = 27Qk* Dok 4 9-Qk« D2") p (p> 27 )0=0 
3-Gk* 1) gak + a= (3 1) (22) © 1, so Var (X,) =]. 


E(X;) 
Е (1 X, d. = 2-Qk*0) 93k p gak t1) 93k — 5k 
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(B,)70; s ò; ЕЕ. с o? = п, У = XE(I E у=2+ 2? Ды „д ы 27 = 


ee А аш ate ind), 5. . 2(2" in? 2) 

; = lim —— = lim —— —-- = lim : 
87902,7 р пэ (3/2)n" пэ (3/4)п! 

where we have used L’Hopital Rule to evaluate indeterminates. 

Since condition (1) is violated. C.L.T. does not hold for this sequence. 


(b) EXE SE Е реро (1 = 1-26) 0-0 
E(X;) = Lk?* 28 444-29 02а) = 1, so Var (X,) = 1. 
EUX, P) = 126 д0 1p үш да 


2 
(B) = сг +05+...4¢02%=n, у, =ZE(IX,P)=1% +27 9n". 
Since each term in the last sum < п“, we have v, < n(n%) = (л)®* '. 


а +1 


Since Lyapounov’s condition (1) is satisfied, the C.L.T. holds for the sequence in (b). 
Example 4. Does the WLLN follow from Lindeberg Levy C.L.T. 
Solution. The WLLN for the i.i.d. sequence (X,) states that 


lim P{S, /n) - ul « c] = 1, (с> 0). 241) 


Since c is fixed, for any positive k (constant), ko Jn «cn for all sufficiently large 


values of n (because any large multiple of Jj is negligible in comparision with the 
small multiple of л). This provides for the following sub-event relation. 


(I$, - nul «ko Jn) с (IS, - nul« nc) 
$ — my 


P4|———-—|«k,szP 
(een 
As n > œ, the left member converges to 2y (К), by C.L.T. Given any ё > 0, we can first 


choose k so large that the value of 2 w(k) exceeds 1 — ô; then choose n so large that 
relation (2) holds. It follows that 


P(ISn) -ul«c)»1- 8 
for all sufficiently large n. This is equivalent to (1). Thus, the WLLN is a corollay to C.L.T. 
S -ES) Сы а ed | en. М 
n n = mpl. — е =limP} |S, е f(n)dt =l. 
n «| п | (S) | в/у/п) m» i5; o Г. 
Example 5. A sequence of independent variates (X,) is defined by 
PX, =0) = 12 PK He = РК Р(Х, = – 0) =. 


Show that the Lyapounov condition is satisfied only if c < 1/2, and the variable 5, is 
*Symptotically N(0, n). 


5, = np 


Р{1,521< k) 


< 3 for large n NN eA 


Note, imp] 
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Solution. E(X) окт) + (Le?) CKD (002) 20; EXD = KE [Le eigen. 
Thus, Var (X) = E(2)-E' (X) =}; E(S,) = 0, pi = = Var ($,)= Var (XX, 


Now E(X, - pn, P) = E(X,P)-2k*. (ik dd Api d л : 


y. = E(EIX,)21«2 43 4. En <п(п“). [if c 2.9 


3/2 _ – (1/2) 


Thus, = (w/Bysm*' In 


If c «1/2, 4, — 0 as n — œ (A x 0), so Lyapounov condition is satisfied. 


If c > 1/2, X, is unbounded. For c = 1/2, we note that 


X, = (14+ 42 43 +... а/п) т? - (1/0) Та) = | Vx dx - 2/320. 

Thus, Lyapounov condition is not satisfied. For large n, 5, 

M(r:X)s Ее) = пг) +1 п 2 (e" +e" )= 1-и x ьп cosh (п t) 
M(t: S,*) = M(t:S, 1 4n) = Mtl Уп: 5,) - IMG Yn: X, 


= [l-n +n” cosh (п 1 Jn) =[1 +t /2n + "nne дт 


S. ~ МЖО, n). This we may verify 


lim M(t: S)= lim iet =e е? = [m.g.f. of N(0, 1)], if c < 1/2. [Euler's limit] 


Thus, S* ~ N(0,D, i.e.(S, / n^) ~ N(0, 1), i.e. S, ~ №0, n). 


Problems with Solutions Provided at the End of the Text 


1*. LetX- Pois (3n) and define Y = (X – 3n)/ „Зп. Using C.L.T. show that the limiting 


distribution of Y is N(0, 1). 


2*. If X, з» X, are i.i.d variates, with p.m.f. P(X, = +1) = 1/2, show that C.L.T. holds 


for tid sequence. 
3*, If X,, X,, ..., X, are i.i.d, with E(X) = 0, Var (X) = o^, that 0 < o? < o, show that 


є > 0 be real (X = XX, / n). 


т i 1 —ne? 
Р(Х 2 в}= оте exp [25 for large n. 


if 


90) 


4*. Prove that if {X,,n21} are i.i.d. variates, then СІ. Т. is a stronger result than wil 


5*. Let X,, X» ..., X, be i.i.d random variables with E(X,) =p, Var (X;) - 9 | «e 
E(X, - ц)“ «14 o*. Now state C.L.T. and evaluate 


im re йу CE Sut <o "x 


n>n 
n iz] 


mi! 


Am 


7*. 


8*. 


9*. 
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is the mean of a random sample of size n from U(0, 1) population. Let 


X, 
E Jn (X, — 1). Show that F(t) = lim P(T, € t) as n — со, exists and find it. 


Nn 
Let (X,) be a sequence of non-negative i.i.d variates with Е(0п Ху «o. Let 
rn 
Y, =(X,, Xp, ..., X,) ". Show that a constant k > 0 can be so chosen that the 
variate (kY,)"" has non-degenerate limit distribution function and find it. 


Give an example of a distribution which satsifies Lindberg condition but does 
not satisfy Lyapunov condition. 


Construct a sequence that obeys C.L.T. but for which the three conditions [(L), (F) 
& (UAN)] do not hold. 


Exercise 17(a) 


. Let Xp X,, ..., X, be i.i.d. variates with p.d.f. Дх) = 1xl, 1 «x € 1, f(x) = 0, otherwise. Show that 


C.L.T. holds for the sequence (X, }. 


. Let Х|, X», ..., X, be a sequence of i.i.d. random variables. Show that C.L.T. holds for the 


following p.d.f.'s of sequence (X, } 
(a) P(X=+1}= 1/4, P(X =0)=1/2. (b) Дх) = 1/2e "', -o«x«o 
(c) f(x) = V2, x1 < 1, f(x) = 0, otherwise. 


. Check whether the C.L.T. holds for the following sequences (X,) of independent variates : 


(a) P{X,=+2*}=1/2. [Мо]. (b) P(X,-tk')-1/2. [Yes] 
(с) P(X,-tk]-1k"^, P(X, =0)=1- k"? [Yes, LLN. No] 
(@) P(X,2t1)10-2*,P(X,-t25-2*'. [Yes]; 


(е) P{X, -t42k-1)-1 
(0 P(X, =1}=p,, P(X, =0)=1- р,,0 < p, «1. 
(p Р(Х, = +1) = запа ѓогќ2 2, c»l. 


(h) P(X, =+ 1) = 1с P(X, =+0=-7 01-7), P(X, -0)-1- 1/0) – 201-170). 


(i) P(X2z2*]-2 ?**" РОХ, 20)21-27^  [C.L. T. No; LLN. Yes] 


- Let Xj, X,, ..., X, be an infinite sequence of independent variates with p.m.f.. 


Р(Х, = + (Inn) =f", P(X, = 0) = 1 - 2r, where t = (n + о) [Un (n + о)]? 
P being a sufficiently large constant. Further p and k satisfy the inequality 2k + | > p. Show 
that that the C.L.T. holds for p < 1. What happens if p 2 1. 


. Let Y, ..., Y, be i.i.d variates with P(Y, 2-1)  P(Y, = 1) = 1/2. Let X, = J5Y, / 4* and set 


S =X, +... +X, Prove that P(1S, 1x 1/2) = 0 for every n 2 1. [This shows convergence to o 
is impossible]. 
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6. Standard variates X and Y are independent with a common distribution Py. [fax + b Yha m 
We МЫ 2. 2 | ч a 
distribution Py, whenever а + b^ = 1, show that P, corresponds to the normal density ф(х 


7. Let Z, be the normalized sum of n 1.1.4 lattice variable with span h and variance c^, The, 


each x specified by _ оли к= 0, + 1, + 2, 


- Show that 
суп 52/2 

lim —— P{Z, = х} = = е А 

n» oo h P 3 т 

8. Show that C.L.T. need not hold for random sums of random variables. 


17-40. Cramer’s Theorem 
Sequences (X,) and (Y,) of r.v.’s are such that X, > X, and Y, ——» c, (c #0), then 


(X, / Y,) —5 (X/c). 
We ommit the proof but give some illustrations : 


Example 1. Let X,, X, ..., Xz, be 1.1.9. N(O, 1) variates. Find the ous distribution 
of Z, = U,/V, where 

|n X1 2, y2 2 
ey =X, +X, t.t. 
- 5.55.5 :J n^ 2 


Solution. Let Ү = X;;.,! Xj; then Y, is standard Chy; О, = EY, and U,/n = У(Ү,/ п) is 
standard Chy. [It follows by Ch. Function]. We conclude that (U, / п) ——» Chy (1,0). 
Further X? ~ 2): so EQ) - 1. We infer by Khintchin's WLLN that 

(V,/n) СХ?) п э 1 ЕСО, 


U U,/n 
-— PESCE | £L > Z~Chy (1,0), by Cramer's Theorem. 


n 


Example 2. Let X,, X;, ... X, be iid. №, 1) variates. Find the limiting distribution of 
Vn (X, +X, +...+ Х„)]/(Х? + Xp +... + Ху). 

Solution. Let U, = (X, + X, +. XM dn: and V, = (X? +X} +.. 5r 3*)/ n. 

Since X? - Yid E(X?)=1. Hence by Khintchin's WLLN, applied to sequence os ) 

y, “> Ц= E(X? 1. 

M(t: U,) = (Mat/ An: XY =e" => U, —— Z where Z ~ №0, 1). 


Hence by Cramer Theorem, (U, / V,) ——» Z, where 2 ~ N(0, 1). 
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Example 3. Let X,, X», ..., X, be i.i.d. standardized variates with E(X^) < o. Find the 
limiting distribution of Z, = Jn [X, X, + X, X, +... + X, ,X4,]/ (X2 + X2 +...+ XD. 
Solution. 

Let ү, = X5i-i X; ; Then КҮ, =E(X,;_,)E(X,;) =0 and E(?)sE(X;. | y E(x, y BI 
Thus Y, is standard г.у. The Seq. {Y,} is an i.i.d. sequence. If S, = Y, +... + Y,, then by CLT, 


B 


Sa = [($, -0)/ Jn] — Z, where Z is №0, 1) 

Consider the sequence OO REO ET Apply Khintchin's WLLN, 
Vim (X?4X2Lx.4-X2/n—2E(X;)-1. 

Hence by Cramer's Theorem, Z, = [S / pet Z, where Z - N(0, 1). 


Exercise 1. Let Х|, X,, ..., be i.i.d. variates with E(X,) = a and Var (Xj) = с? and 
ey Xin 
j=l 


Let Y,, Ү,, ... be i.i.d. variates with E(Y,) = b (+0) and Var (Y,) = т? апаў, = XY, / n. 

Find the limiting distribution of Z, = Jn (X, —a)/Y,. 

Exercise 2. Let X ~ Pois (A) and Y ~ Pois (и) be independent. Prove or disprove : 
(ГОХ — Y) – A — ШУХ + YY" ] > NO, 1) as А — ©, p> co. 

17.50. Continuity Correction 

When approximating a discrete probability law by continuous probability law, it is 


useful to adopt the following rule : 
"Add 1/2 to the upper bound and subtract 1/2 from the lower bound". Thus, when X is 


discrete a more accurate evaluation of P(a < X < b) is provided by Pla -1<Х<Ь+ H. 


Comments. Apply continuity corection only to closed intervals. For open or semi-open 
intervals first convert then to closed intervals and then apply continuity correction. Thus 


Р(а<Х <b) = P(a- 5sY &b* 3); P(X >a)= P(X 2at+l)=P(¥ 2a+! — 5) 
Pia X $5. Р(а+1<Х<Ь)=Р(а+1-.5<Ү Sb 05) 


P(a« X <b) = р(а+1<Х<Ь+1) = Р(а+1-5<Ү <Ь+1+0.5) 


Continuity correction is applied only to discrete variates, not to those who are already 
continuous. 
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17-51. Normal Approximation to Binomial Distribution 
inomial Distn 


De-Moivre-Laplace Limit Theorem : Normal approximation to Bin 
Let X, bin (n, р) and Set Z, = (X, —np)/J/npq. Then 
Pas Z, <b} = Р{пр+а/пра < X, «np * b npa} > ФО) - Pa), as n> о 
Proof. Show by MGF method that Z, follows №0, 1) distribution. Then the 
P(asZ,sb) = PIZ sb) - PIZ, Sa] = Ф(Ь) – (a) as n o. 


17-52. Classical Approach : Normal Approximation to the Poission 
Distribution 


If X ~ Pois (A) and if X and X are large, then U = (X – }„) / VÀ is bounded. Also 


Aspiras Aa PER) d- 
Werl ae Ln Га X M cl) 


Hence, for large А, u,,, —u, =1/ Và = ди= X^, 
Taking logarithms of f(x) = e^ X' / x!, and using Stirling formula for x, we obtain 
т fix) = хп А-А in(xl) xin —- X -tn( 2n eti) 
= x(inA-1)-X- (L-x)inx-n 2n. 


Putting x = (1+ u/ VA), u/ VA being very small, we get 

т g(u) = А+ VA) inX 7X - (13 X X tn X (1+ u/ VX) + const. 

ud - [1 X X ]tn 1 u/ WX) - ln 22. 

dX |+] ul VA -u 123) +] рх 

ie.  W[V2na gü)] = -tu «O0 (0/ JA) NO 
When A — ©, using (1) we get dg(u) = [V2n)"! exp (—u?/2)] du,  — © «u« o. 


Thus, a Poisson distribution with a large mean may be approximated by a normal distribution- 


17-53. Worked-out Problems 


Example 1. Use the normal approximation to the binomial distribution to determ!n? 
the prob. of getting (i) 6 heads in 16 flips (ii) 20 heads in 40 flips, of a fair coin. 
Compare the results with the exact solutions. 

Solution. To find the approximations, we need continuity correction, which red 
to replace a non-negative integer k by the interval [k — Lk] 

(i) Here n = 16, х = 6, p 1/2,u=np = 8; o! = прд = 4. i 


uires 
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t 55-8 X- TORT аг: 
P pX-6)- P(55« X «65 pied 25568 
pz РХ )=P{ | ela a P{-125<Z< -0.75} 


A p{015£Z< 1.25}, by symmetry 


203944 – 0.2734 = 0.1210. [Table of Normal distribution] 


The correct value from bin (n, p)-Table is 0.1222. Thus, 
the error of approx is —0.0012. 


(ii) n= 40, х= 20, р = 1/2 
2 
yz пр = 20, с = прд = 10, с = 3.1623 -125 -75 75 1.25 


hu. 195-20 Х-и 205-20 
= PIX =20) = P195 < X < 205) = p [9520 н | 205-20 
Pa а еа Л 


= P{-0.158< Z < 0.158} = 2P (0 < Z < 0.16) by symmetry 
= 2(0.0636) = 0.1272. (Table-value) 


2 
Example 2. If X is bin (n, p) and np is an integer, estimate the probability that X 
assumes the most probable value when n is large. 


Solution. When n is large, the normal approximation of bionomial distribution, provided 
by CET, is 


40\(1)" 
Actual value Р(Х = 20) = cj (5) = 0.1268. [using calculator] 


P{X=k} = (/2лпра)`' exp [-(k - пр)? / 2npq]. T) 
Now the most probable value (i.e. modal value) of bin (n, p) is [(n + 1) p — 1] and if np 
is an integer, this value is just np. Hence, putting k = np in Eq. (1) we get PIX = пр} = 


1/ J2nnpq. 


Example 3. Let X,, Х,, ... X, be a sequence of Bernoullis’ variates with constant 
Probability p of success in each trial. Using Normal approximation to Binomial 


distribution, find the smallest value of n for which P (1X, — pl<8} is at least y, where 

бапа Y are fixed admissible constants. Compare this value with the value of n obtained 

"sing Chebyshev's inequality. 

Solution, By Normal approximation to Binomial Z=(X, - р)/ «Грат ~ №, 0) for 

large п. 

Неге X, = Q/mZX,;p- p. o-pq!n; 

| P(1X, — plx 8) р {1721< 8 Vni [рд ) - 20 (Gn / 4 pq] - 

Since Jog <(p+q)/2=4 (as AM > G.M ), so Ф (б/п / рд) < PVN) 
А 


! because the c.d.f. Ф is an increasing function. Hence 


Py = P(IX, — p<} 2 2® Qn) – |. 
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Since Po is at least y (i.e. min po 2 y), we get 20 (284n) - 12 > Q(284 n)» | (Ү +1) 
254n > 26 «дуз > n2 [2 5/49] > min n = (1/ 46^) z, „уз ET 
Now by Chebyshev's inequality : P(X- plx6)21-6' 16), [o^ = pq/n] 
ie. pQ21 —- (pq! nd?) 2 1- (1/4n8^). (^ ра «1/4). 
Since p, is at least y, so we must have 
1-(1/4n8))» y => n»1/48 (1- y) => min (n) 1/4 (1 - y) 8’. (2) 
To compare (1) and (2), consider a concrete situation 


py = P(IX, - pl«0.01)» 09. 


ro 


Here $ = 0.01, y = 0.9, % 412 = Zos- From N(0, 1) areas. 
Zoos = 1.645 (critical value having 95% area on its left). Then by (1) 


min (л) = (0.25) x 10000 x (1645)? = 2500 x 2.706025 = 6765. 


By Ghebyshev’s inequality, by (2), min (n) = 10000/4 x 0.10 = 25000. 

Example 4. Let Y denote the sum of the items of a random sample of size 12 from a 
Die-distribution with p.d.f. f(x) = 1/6, x = 1, 2, 3, 4, 5, 6, ; f(x) = 0, otherwise. 
Compute an approximation value of P(36 < Y < 48}. 


Solution. Let Y= Xy * X * ^t X; B= E(Y)=12E(X); Var (Y) = 12 Var (X). 
E(X) = (1/6) (1+2+...+ 6)=7/2,E(X7) = (1/6) (1? 27 + + 6°) 2 91/6. 
o} = (91/6) – (49/4) = 35/12. So E(Y) = 42, Var (Y) = 35. 
Let Z=(Y—p)/o,ie. Y 2424 435 Zand ~ N(0, 1). Now 
p = Р{36<У «48) = P(355 «Y «485]- P(355 <42 + 435 Z «485) [Continuity Correction) 
= P{-(6.5/ J35) < Z «(651435)) = P(1ZIx 1.1} 2 (1.1) = 2(0.3643) = 0.7386. 
Problems with Solutions Provided at the End of the Text 


1*. Two fair dice are tossed 600 times. Let X denote the number of times a total of 7 
occurs. Using C.L.T., find (90 < Xd 10i. 


2*. A polling agency wishes to take a sample of voters in a given state large enough that 
probability is only 0.01 that they will find the proportion favouring a certain candidate 
to be less than 50% when infact it is 52%. How large a sample should be taken ? 

3*. А coin is tossed 10 times. Find the probability of 3, 4 or 5 heads using (а) Binomial 
distribution (b) Normal approximation. 

4*. A lady has 7 dark brown and 5 black (single) socks in a drawer. Each morning 
she wears a pair of socks at random, each evening she washes them and E 
them back into the drawer. Find the probability that during one year (365 day’ 
she will wear matching socks at least half of the time. 


5*. 


6*. 


7*. 


= 


12, 


13, 
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ле! ers from the explosion of a bomb. it is known that the probability 
of a pane of glass being smashed is 0.30. What is the probability that out of 100 
panes of glass situated at a yards from the explosion, 40 or n 
Van of la truck can hold 25 containers (identical in shape and size). If the weight of 
a container is assumed to be a normal variate with mean 150 Ib and S.D. 15 Ib, what 
is the Prob. that $a gontaiter, will overload the truck, if it can safely carry 4000 Ibs. 
If X is N(500, 100^), find the 90th percentile and the quartiles for the Dist. of X. 


логе shall be smashed ? 


Exercise 17(b) 


. (a) If X is bin (72, 1/3), find an approximate value of P(22 < Y < 28). 


(b) If X is bin (100, 1/2), find an approximate value of P(Y = 50) 
(c) If X is bin (n, 0.55), find the smallest value of n so that, approx. P((X/n)» 1) > 0.95. 


. The round-off error to the second decimal place is U(-1/20, 1/20). Find the probability that 


the absolute error in the sum of 1000 numbers is less than 2. 


. If 100 true coins are tossed, how would you obtain an approximation for the probability of 


getting (/) 55 heads (ii) 55 or more heads. 


. A gambler's daily income in rupees has U(—400, 500) distribution. Find the chance that he 


wins more than 5000 rupees in 60 days. What amount k (gain or loss) is such that at most once 
in 20 times on average, the gambler will have income less than k during 60 days ? 


. Let X denote the average of the values shown when n dice are rolled. Find the probability that 


the sum of 600 such averages lies in the interval 100 + 905 ^". 

Using normal approximations, find the probability that 200 tosses of a true coin will result in 
(i) between 80 and 120 heads, both inclusive (ii) less than 90 heads (iii) less than 85 or more 
than 115 heads (iv) exactly 100 heads. 

Show that the probability that the number of heads in 400 throws of a fair coin lies between 
180 and 220 is approximately 2Ф(2) - 1. 

A die is thrown 720 times. Find an approximate value of the probability of the following 
events : (1) 'Six' lies between 100 and 400 (ii) 'Six' comes for more than 130 times. 

Apply the WLLN and CLT to the sequence (X,) of independent variates indicating the eyes 
obtained at different throws of a die. 

If n = 10000, find the limits of S, within which its random value may be chosen. Estimate 
P(S, ) in these limits. 

The number X of items of a certain kind demanded by customers follows Pois (9). What stock 
k of this item should a retailer keep, in order to have a probability 0.99 of meeting all 
demands made on him ? Use Normal approx to Poisson Law.. 

The number of people entering a store is Poissonly distributed with parameter 100 people per 
hour. How long should you wait in order to have a probability of 0.74, that more than 180 
People have entered the store. ? 

Let a X,, be a random sample from f(x) = 3x, 0 < x < 1; f(x) = 0, elsewhere. Find 


P(06 < X,, < 0.8} approximately. 


Let X, ..., Ху, be a random sample from f(x) = Ux, 0 « x « o ; f(x) = 0, elsewhere. Compute 
tween the probability that more than 50 of the items of the random sample are less 
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14. A random walk on the x-axis is governed by 


15. 


the following rules. At each step, the Change , 
© 0 


n $ og? * d EX . " T | L 
the attained coordinate position is +1 with probability 3 Uf. with probability > . Steps s 


taken independently of each other and the initial position is at the origin. Show that the 
probability that the walker is to the right of the origin after a large number n of Steps ic 


approximately o(1 Vn). 
Obtain Mr) when X is Pois (A); find the limit as À — © of m.g.f. of (X – А)/ VÀ. and interpre 


the result in the context of the C.L.T. Also prove that 


p =À 4k е 
lim У Lus. tuis Ај ee (о = А + а^, B - + dvd) 

n9 poo k! Ул а 

Show that 2X is not Poisson Variate. Give a set of conditions under which X + Y too is а 
Poisson Variate. 


We all learn by experience, ... never lose sight of the alternative. ' 
[Sherlock Holmes in the Adventures of the Black pete" 


ihini 


Pain is life—the sharper, the more evidence of life. (Charles Lamb) 


Uniform Distribution. 


Exponential Distribution 


18-10. Definition 
The random variable X, with a p.d.f. given by 

f(x) = 1/(b-a), а<х<Ь, (b»a); f(x) -0, otherwise А) 
is said to be a Uniform (or Rectangular) variate оп the interval (a, b) and f(x) given by 
(1) is called uniform or rectangular density function. If X has the density function (1), 
it is expressed by writing X ~ Unif (a, b). a and b are called parameters of the distribution. 
For uniform distribution, subintervals of (a, b) that have equal lengths, all have the 
same induced probability and hence all are equally likely. Thus the statement “choose 
a number at random in the interval (a, b) always mean that a number is the observed 
value of X where X is Unif (a, b). The probability that X takes on a value in the interval 
(c, d) с (a, b) is given by 
d-c 
р-а’ 


РЬ= J f(a des 


Р is called an interval function. 
Distribution Function. If X is U(a, b), the c.d.f. is 

F0 x«ai F Ax) zx—a/b-a,aSxsb;F(x)z1l, xb. 
The graphic representation of f and F is as under : 


f(x) 


f(x) = 1/(b — a) 


0 p.d.f. of U(a, b) 0! cdfofU(ab) b 


Example 1. Find the distribution function of the larger root of the equation £^ + 2: ~ X 
= 0, where X is Unif (0, 2) distributed. 


Solution. From given equation, the larger root is 2 = /1+X - 1, ў, (х) = 1, 0«x«2. 
Now F(z) = P(Z« = Р(Х <? +2z}=4 bho йх= ‚(С +22) 


Since Q « <9 — x Arae tsi, so the p.d.f. of Z is 
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F(z) = f,(d=z+1, Oszs43-1; fz(2)-0, otherwise 

Example 2. Name three distributions for which P(X < p,) = E. 

Solution. Trivially : bin (2m + l, 1/2); N(0, D,U (0, 1) 

18-20. Moments 


If u’ and p, denote rth order simple and central moments, then 


" M dx pn a 


ш = EOI eye 


In particular, mean p; = 5 (b +a) 


= = E(IX - 1a by [== a 


-É z dz [z-x-i(a*b)c-i(b-a) 
Obviously, if r = 2n + 1 (odd integer), the integer vanishes, hence 
Bossi. US Supe. 2. 3... 

If r = 2n (even integer), the preceding integral reduces to 
= peab d= л» 


bho 


Ho, 


In particular: Маг (X) = № = (1/12) (b - a, p, = (Б- а)*/80. 
The absolute moments follow easily : 
Wee ich astra 
-A 


ae e| 2 Jet b-a ЯСЕ Б 


» p a (b — a) i 

= b-a(r+1) 2/'(г+1) 
Observe that v, = M.D. about mean = (b — ay4. 
Pearson’s Coefficients : |, = 271210, B snp, = 9/5; 7, = = JB, 20. y; - B; 232-615. 


Since y, = 0, the distribution U(a, b) is symmetric (not skewed and y, < 0 implies E 
it is Platycutric. Notice that the point (B, B,) lies on the straight line B, – Вг- 3 = -6l 


ь1х-1(а+ 6)! 1 


X- 


18-21. Moment Generating Function and Factorial M.G.F 


bt - at D 
M(t:X)- E(e*)= fre Р а. B ар l E - | reo. [8 8-16 (9)] jl 


We expand O to a 


ie es oe тү a pert curn P" AD) 
M(t: X)7 37 M n! ) a sequ п+1 п! 


а һ=\ 
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n nl n4l 
н, = Coeff. of — = Е 2 | 2 


b-a n+l 
а AE ' Ч ә ^? ? 
In particular, H= 2 (b+a), H2 = (b? = a^)! 3X(b — a), o = 5 – щі = Eur а). 


Characteristic Function: M(it:X) = (e'^ —e')/it(b—a). 


EU St” 0:20 аз 


= i f: 
а-а) Ё b= antes [Factorial m.g.f.] 


18.22. Mean Deviation about Mean, Median and Mode 


plx—-t(a+Db)l 1 


МЭл= E: x= = EE Аа асер = c d 
( ph) ih (Ьа) ах ти 2 
2 с 2 DE 
г. so раі S. [= х1 (a+b), с=т (®-а)] 


If m is the median, then 
1 т 1 т =н 
ке TCHS SS р ac mum 
This result is otherwise obvious, since the distribution is symmetric about the mean 1 (a+b). 
Mode. Since in the rectangle (b — a) x (b - a), each point in the interval (a, b) has 
the maximum probability, it follows that each point of (a, b) is a Mode. Some authors 
say that the mode does not exist. 
Note. v, -E(IX - ul) = (b— a) /(r* 112 

iuum В, 2G - a) M'Qr + 1). 
Example 1. Let X ~ Unif (—a, a). Determine a so that 
(i) P(-« X < 2) = 0.75, (ii) P(1XI« 1) = Р(ІХІ> 2). 
Solution. Here f(x) = (1/2a). So that 


(i) 0.75 = ffo) dc - 2 heey 


ij f, dic p & > 4-1-2 = а=3 


5 m=> (a+b). 


Example 2. Let X and Y be i.i.d. Unif (1, 2) variates. Compare E(X/Y) without using 
the density of X/Y. 


| D ые] 
Solution. Here E(x) = Ü xdr-5. E(Y Nef "D aps 1zxsz2] 
E(X/Y) -E(X). E) = (3/2) 2. [X & Y are indep.] 


18-30. Probability-integral Transformation 
If the гу x has c.d.f. Fy, where Fy is continuous, then the г.у. Y = Fy(x) is U(O, 1). 
ed Since 0 < Р(х) < 1, V x, we have F,(y) = 0, for y < 0 and Fy(y) = 1, for y > 1. 
ч 0« y < 1, define z to be the largest number satisfying F(z) = y. Then F(x) < y iff 
2, and it follows that 
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F Ay) = Р(Еу(х)< y}= P{X szj}=Fy(z)=y 


which is the uniform distribution. [Another proof uses m.g.f. technique] 


18-31. Rejection Method for Continuous Variates 


(i) Suppose that f( - ) is defined on a finite 
interval (a, b) and is bounded by m. 


The graph of f(x) is enclosed in the rectangle R : 
а< x €b, 0€ y < m. We accept points (x, y), chosen 


at random in R, which lie in the shaded region and 
reject which lie outside. 


For random points (x, y), we use distributions of X, as unif (a, b) and that of Y, 
independent of X, as unif (0, m). Thus the joint p.d.f. is 


УУ) = 17 im(b— a), asx<b, O<y<m. 
Write А = {Х ассеріей)} = ((х, у): а<х< 0<у< f(x)}. 
Вто. "dy * 1 b L 1 
PAS = ч je xac f(x) dx) m(b—a) 
ай pron day > 1 Xo _ F(X) 
P nir 2L d t 25) xia А ГО = на) 


P(X < xo 1 A) = P(X < ху, A}/ P(A) = F(x). 
(ii) Suppose that f(x) is defined on an infinite interval ] —оо, oo [, f(x) being bounded. 
Now we cannot choose a value from a distribution which is uniform over an infinite 
interval. Suppose however we can find another distribution, with p.d.f. : g(-) and a 
constant c > O such that 
fix) < cg(x), [V x, g(x) > 0, f(x) > 0] 
Now, a random value X is drawn from g(.) and independently, a value U is drawn from 
unif fO, 1). If the realized pair x, u satisfy 
и < fox)lcg(x) [set h(x) = f(x)/cg(x)] 
we accept x ; the event A in this case. So 


P(A) = wi | ү fx, u) du) dx. [ f(x, u) = f(x). fau) = g(x). 1, by indep. 
ы © 1 
= р gc (feu) dx Г, код Wade = J" fade 
F 3 
P{X< Xo» A) = B (oo и) du) dx =1 m f(x) dx = Pw) [As above] 


P{X <x, lA} = PIX £ x, A)! РОА) Е(хо). 
Note. Ko sm. = f(x) € (т. (b- a)) {1/(b - a)} = cg(x) > 
where с = m(b — a) and g(x) = l/(b — a); which provides case (i) from (11). 
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18-40. Formula for Sum of Uniform Random Variables 


pet Xp Xo o X, be i.i.d. Unif (0, 1) variates and 5 = X,+X,+...+X,, X,=S,/n. 
ge: C, 2 xif x20 Ed C 20, ifx«U 


pefi 
The pdf. of S, 15 g,(X) and that of X, is А (у) where 
] n + » 
80) = rg 2, CP (") Cag". * ea eredi 44) 
nis r(n ы r r+l 
- ET С s n Г Чд Р 
h,(y) Г(л) 2 ( ) Wr aed ПАР R 6) 
Proof. ЇЇ X is Unif (О, 1), then 
A | x 1 F3 er 1 = et : ` 
M(-t : X) = E(e™) = | e" dx= ; MTS y= : ‘ riy 
To show that g,(x) in the density of S, we proceed as under : 
SUL n= ә [ee f. ng РА ii 
Е ax Se Snr) асер е". dee 599 nre d (п) 
The m.g.f. corresponding to distribution g,(x) is 
00  —Ix an = Йе TOS: = pei dx 
E T > cy (7) етс ч 
- ЗОНА [by Gi Gii) 


Since (iii) is identical with (i), we conclude by virtue of Continuity Theorem for m.g.f. 
that (1) is the density of S,. 
Now let Y = Sin = X/n. (X = 6 1) then 


ny 


Fy) = PY у) = Р(Х <пу) = jy fx CO dx. 
Differentiating : fy) = nf (ny) which is the result (2). 
Generalization. DEI UE, .:. 2, be i.i.d. Unif (a, b) variates, Z 2 Z, + ... + Z,, 
T-Zn- Z, and let h = b — a. The p.d.f. of Z and that of T is 


ә А YU © (—1)' (") [Cezar па+ rh « z&na * (r + Ih. (3) 


(r+ Dh 
TS 


n TS h 
hli) = TUE Bc lt [Се ay - 7] ү a+ <15а+ (4) 


г=0 
го 
^f. Let X; = (Z, – a)/h ; then X, ~ Опі (0, 1). Now 
X=X,+...4X,=[(Z, +. 2,) – naVh = (Z - naylh 


= PIZ <2) = Р{АХ +na<z)= P(X <(c—na)/h} = |; 5,0) dx. Ө = (z - na)/h 
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Differentiating w.r.t. z we obtain 


b tns 25 а ру dj А п-1 1 L па 
fAz) = ГА | һ )- У, ( 1) f (Ci nalh yi rin)’ А h Р 4 | 


А „со 


Ед) = PIT <t}=P{Z<nt\= [и 7.0) dz 
Differentiating : F,(t) = nf (лг), which is the result (4). 
18-41. Special Cases Illustrated : 
= d {3 r *1 A 
Es h,(y) = ro yo? (Jte. AIS [Mean of two variate 


= 2[C,, 9 26-1 +С, ,_],17 = 0 gives t, rz | gives, +t, r=2givest, +1, +h] 


= 20yI(0« y&1/2)*[2y -20y - 0I 1/2«y «3/2)« 2y -22y - D + 2y— A I< ys3/2) 


4у,0<у<1/2 
= 44(1- у), 1/2<ys3/2 

0,у>3/2. 

Ta Tí. 1 
2. һуу)= 2l (-D (3) [Css T. E [Mean of three variates] 
(yy, 0<у<1/3 r=0 

` 3] Gy – 3(33- V^, 1/3«y 2/3 ral 

2 | yy! - 33y -1 + 38y - 2^, 2/3<ys! r=2 


(зу)? -38y — 1) «33» - 2! - y - 9", y»1 г=3 
= (272) Y K0« y € 1/3) + 27 0/12) - 0- 1/21] КИЗ) < y $ 2/3) + (27/2) (1 У) 10/3 «v $ V) 


3. g3(x) = ty (-1) B ан ur r«x&r«l [Sum of three variates] 
xg, 04х51 r=0 
px -3(x-1), 1< x82, r=) 
es x! -3(x - D^ 4 Xx 2), 2<х<3, r=2 
x! - 3x — 1)? + 3x - 2) — (x 3)", x»3 
fx» 3 


= (25€ KO < x $ 1) + (3x х - 32) I «x $2) + (x - 3*2] IQ «x «3 +0 

Note. Some authors write C(x) instead of C, and some include left ends inste 

right ends. For instance : » 

Cx) - 2 Cx - 1) + Cx 2) = 0 (x < 0) + х1 (05 х < 1) [x = 2(х - 01 KC sxs ^ 
+ [x - 2(x- 1) +(х-2)] 2 <Хх<: 


ай о! 


.. $18-42. Веру of Worked-out Problems 549 


а 
18-42. Bevy of Worked-out Problems 
Example 1. Let X, Y, Z be i.i.d. Unif(0, 1/2) variates. If V = max (X, Y, Z) and 


w= min (X, У, Z}, find P( 1/3 < Wand V < 1/2} ; P(V < 1/2) and P{W > 1/3) 
Solution. Here F(a) = [ах = а, so F(1/2)=1/2, F(1/3) = 1/3. Now 
(vst) = {Х<1,У<1,7<1} => Р(У<1) = [РОХ «br = (0/2) = 1/8 


(W> 1/3) = (X»1/3Y 31/32»1/3] => РОИ > 1/3) = (РОХ > D = LL - F3] = 8/27 
{1/3 < W, V < 1/3) = {1/3 < X < 1/2, 1/2 < Y 1/2, 1/2 < Z < 1/2) 

. P413 < W, V& 1/3) = [P(1/3 < X < 1/2)]? = [F0/2) - FABY? = (1/2 - 1/3)’ = 1/216 

Example 2. Let X and Y be i.i.d. Unif (a, b) variates and k € (a, b). 

(i) Find the number k such that the probability that at least one of X and Y exceeds k is p. 


(ii) Find the number k such that the probability that both X and Y are less than k equals 
the probability that exactly one of two is less than k. 


Solution. Let A = (X > k}, В = {Y > k} ; then 


P(A) = P(B)- |; at pay = 


(i) p =P(AUB)=1- P(A) P(B) -1- [((k - a)/ (b—- a). 


(k - ay(b- a) = Jl-p =» k=a+ (Ь- а) 4/1 - p. 
(ii) P(AB) = P(AAB) => P(A) P(B)= P(A) + P(B) - 2P(A) P(B). 
Thus 3P(A) P(B) = 2Р(А) => P(B)=(2/3), P(A) #0. 
Using (1), this gives k — a = (2/3) (b - a) or k = a + [2(b — a)/3]. 


Example 3. If a, b, c are randomly chosen between 0 and 1, find the probability that 
the quadratic equation ах? + bx + c = 0 has real roots. 


Solution. The variates a, b, c are i.i.d. U(0, 1) and their joint p.d.f. is 
fla, b,c) = 1,0 <а, b.c & 1. [ fla, b, c) = f (a) f(b) lo) = 1] 
The roots of equation ax? + bx + c = 0 are real iff b? > 4ac. Thus, 


P{roots real} = P{b? > 4ac} -1— P(P^ < 4ac] wef) 


- 


а. 


с= 0 Јр= 0 
Thus, P {roots real} = 1 — (8/9) = 1/9. [by (1)] 
Example 4. If X is a random variable with a continuous distribution function F, then 
Y = F(X) is U(0, 1). Further, if f(x) = $(x—1), 1s x53; f(x) *0, otherwise determine 
What interval of Y corresponds to interval 1.1 < X < 2.9. 
Solution. Y = убх) is the c.d.f. X, then Y ~ U(0, 1), [8 8-16 (10)] 


Further, for given p.d.f. : F(x) = f 1(-Ddr2 1(x-D, 1<х<3 


P(b^ < 4ac} = a | е da db de = f, А Vac dade - 2 [Ја da f, Ve de =$. 
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Now Y = F(X) is Unif (0, 1) ; so we define the mapping y = +(x 1)’, then 


1<Х<29 > 1i(1-0D!s1(X-D'«s1Q9-1), = 0.0025 <¥ <0.9025 
Example 5. If X and Y are independent variates, each uniformly distributed over (0), |, 
find the distribution of U = X + Y and V = X - Y. 


Solution. Let u = x + y, v = x – y, and invert them to get x = 5 (ut v)y-i(u-v) 


IJI = lo(x, y)/ д(и, у)1= 1, so dx dy = 5 du dv. 


The range in the x-y plane and that in the u-v plane are as shown. 


Mapping flat square to a Diamond square. 

I. :ye0,02z-$21709 Yoru Canes, ПЕ ЮЕ Ир < 1. 
П : 1601065 $109» ven, US 8E $2, (te 0. Su, —-v 1. 
Ms ye losers ше шер = 09041752, 16.155u$2,-1svzx0. 
VV > «c= Lo у S teres Venu eves. | swe 72,0<v il. 
Since X and Y are indep.; their joint elemental p.d.f. is 

dP (x,y) = f(x, y)dxdy=dxdy = арР, (u, у)= ий.  [f(x)e1- 5,0) 01 
We now integrate out v from Eq. (1) and obtain 


dP,(u) = tduf' dv, Osusl E Osusi: 


2-u, 1<и<2 


-u > (и) = 
їди |[* dv, 1<и<2 M | 


We now integrate out и from Eq. (1) and obtain 
dP,(v) = lap" du  Osvsl 
гау] du, -1<у<0 


Example 6. If X,, Х,, ..., X, аге i.i.d Unif (0, 1) variates, find the distribution of the 
geometric mean С = (X, . X, ... X,)'^^, 
Solution. If X ~ U(0, 1), then f(x) = 1, 0 <x < 1, and 


M(t: -Àn X) = E(e" "*) - E (e? sE aL е-и П. 


$18-42. Bevy of Worked-out Problems б 5 1 


« M(t: - Un X, - ... -ln X,) = [M(t:-UÜn X]' - (1-0). [X, arei.i.d.] 
і.е. M(t:V) = (1-0) ", Vz-ZUnX,--Un(X,. X, ...X,)=—-M(G)". 
This being the m.g.f. of gam (1, л), it follows that the p.d.f. of У is 
Ду) = е" у"! гп), 0<v<o. nit by 


Fw) = P{G<w}=Ple"" <w}= P(-(V/n) <nw} = P{V 2 - ninw] 


1- PIVs-nUinw]z1- i f(v)dv [w, = пп] 
Using DUIS by w, we recover 
fow) = —f(-w,)(-n/w)=(n/w) f(-n (п w) 


попу n-] n-i 
n | e" "" (—n(n w) nw = 
Date) fand: 2009). of Wesson tw ЧО <и 1 
(2) T(n) TIE eM 


It is trivially verified : {i fc (w) dw = 1. 
Example 7. Let k be a random number from (0, 1) and let 
T= 1+[0nk/0nq], 0<р<1, q71-p 


where bracket function [a] denotes greatest integer < a. Then T ~ gem (p). 
Solution. For all n > 1, 


P (пк =п-15= Р tag ac Mikal, 
ing inq 


= P((n—-1)inq20Unk»n0nq), [Un q < 0, so inequality reverses] 


PIT zn) 


= P (n (q)' ^! 2Unk » 0 (q)' }, [п is monotone t function] 
= P(q"'2k»q')-P(q' «ksq' ') 
= q''-q' [kisunif (0, 1)] 


= q''(1-q)- pq" |, nzl. 
This proves that T ~ gem (р). 
Comments. (i) To simulate a r.v. T ~ gem (p), all that is needed is to choose a point k 
at random from (0, 1) and let T = 1 + [Un Кп q]. 
(ii) To simulate (generate) X ~ NB*(n, p), recall X = X, + X; +... + X, where X; are i.i.d. 
gem (p). Hence, to simulate X, choose п independent random numbers K,, k,, ..., К 
from (0, 1) К; ~ Unif (0, 1) and let 


n (п А, 
Ta Tes) 
Example 8. Let f(x)  12x/(1 + x, 0 < x < œ, g(x) = 2/0 + 3), 0 < x < о. 
Show that A(x) € c, when c > 3/2, where h(x) = f(x)/g(x). Apply rejection method to 
Simulate (i.e. generate) X from f(x). 


Solution. We convert infinite interval ] 0, oo [ to a finite interval ] 0, 1 [ by using y = 1/(1 + x) 
80 that f(x) dx = ф(у) dy. This gives equivalent : 


n 


n 
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Ду) = 12y!(1 2,0 « y «1, 4(у) 225,0 « y « I, AY) = бу (1- y). 
h'(y) = 6(1- 2y, A" (y) 8 -12,1 (y) =0 => у=, ^0)75. Thus 
max h(y) = 3/2 and it occurs at y = 1/2. So c = ^(1/2) = 3/2. 
h(yyc = 4у(1 ~ y). 


The rejection procedure is as under : 

Step 1. Generate random numbers u, and и, from interval ] 0, I [. 

Step 2. If и, < 4u, (1 — uj), stop and set Y = ш. Otherwise return to step | 
The average number of times that step 1 will be performed is c = 3/2. 


ET 


A". 


2", 


10*. 


11°, 
127: 


Problems with Solutions Provided at the End of the Text 


А man and a woman agree to meet at a certain place between 10 and 11 o'clock 
They agree that the one arriving first will wait г hours, O < 7 < 1, for the other to 
arrive. Assuming that the arrival times are independent and uniformly distributed, 
find the probability that they meet. 


If X is Unif (—b, b), determine b if P( | X | > 2) = 3/4. 
If X is От (1, 2), find z such that P(X > z + ру) = 1/4. 


Let X be Unif (-1, 3). Compare the upper bound on P{ | X - u | > 26], obtained 
from Chebyshev's inequality with exact probability. 

Let Х|, X», ..., X, be i.i.d. Unif (—c, c) variates and define L = min (Х|, X,, ..., X,), 
M = max (Х|, X;, ..., X,). Evaluate P(L < -bor М > a) when 0 «a, b < c. 


The variates a and b are independently and uniformly distributed in the intervals [0, 6] 
and [0, 9] respectively. Find the probability that x^ — ax + b = 0 has two real roots. 


If Xp X», X, are independent r.v.'s, each uniformly distributed over (1,1 >), show 
that E(X*) = 13/80, where X = X, + X, + X}. 

Let fy(x) = 6x(1 — х), O € x < 1. (i) Find y as a function of x such that Y has р. 
gy) = 30- Jy), 0s ysl. 

(ii) Show that Z = 3X" – 2X’ follows Unif (0, 1) law. 

Derive a random sample from the distribution with p.d.f. : 


(i) f(x) = 2xe", х>0; (i) f(x) era /x'*', x2a. 
Random variables X and Y are i.i.d. and have Unif (0, 1) distribution. Show '! 
$(:1X-YI) = 2[l«it-e"]/ e, (t real). 


Deduce that E[| X – Y I]" = 2/(п + 1) (п + 2). 


If X and Y are i.i.d. Unif (0, 1) variates, find the distributions of XY and X/Y 


If X, Y, Z are i.i.d. Unif (0, 1)-variates, show that the distributio? ° 
W = 2(X + Y + Z) - 3 15 given by 


безд, 


fiw) = 


Picante fiwy= 8 А, toe =t 15953 n 
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Compare the p.d.f. of W with that of №0, 1) and show that 2W — 3 is not a bad 
approximation for №(0, 1). 


18-50. Triangular Distribution and its m.g.f. 

A random variable X possessing the following 

p.d.f. is called triangular variate : 
2(x-a)/(b—-a)(c-a), a<x<c 

fx) = 2(b-—x)/(b-—a)(b-c), с<х<Ь ..(1) 
0, otherwise 

Such a variate is written Trg (a, b) ; there is 

peak at x = c. 


Dae. Bi att 2(x —a) dx b x Ab—x)dx 
Ma: = [,e Ak yia (b —a) (b — c) 


PES d: eta ( S22) Pe eee e eee) 
(b—a)(c—a) | 1? t gp)J| (b-a(b-co) (г — 


at bt ct 
2| S - ieget Nt: 


= ——‹———+  -—— 


(a-b)(a-c) (b-a)(b-c) (с-а)(с-Ь) 
There is an excellent symmetry in this expression ; and the form seems to be new. If 
we expand the exponents involved, Coeff. of t? and ғ disappear, constant is unity 


confirming M(0) = 1; and 


E(X) 


Ml Sach Er OED 
3 |\(a-c)(a-b) (b-a)(b- c) (c — a) (c — b) 


c. ies ep Grabs € 96-5 
Е(Х?) = 6)G@-o@_-b (b-a(b-c. (c-a)(c-b) 


these being the Coefficients of t and г2/2 ! in expression (2). 
Example 1. Find the m.g.f. for the triangular distribution 
Кх) = х, 0<х51; fi) = 22—25, 1 ек2: fi» = 0, otherwise . 
If Y and Z are independent U(0, 1) variates, show that Y + Z has triangular distribution. 


Solution. 
i a-p) [ede2r-xo| e- |, 
M(t) = b e" xdx+ f 2-x)e* a - | =O} [zem NEST ... (4) 
1 
Since Y and Z are independent U(0, 1) variates, so 
EE 


M(t: Y+Z) = M(t: Y). M(t: zz Ме — yr. 
From (i) and (ii) it follows that V = Y + Z is Trg] (0, 2) variate, 
g(v)=v,0<v<l; g(v) = 2-v,1<v<2,a(v)= 0, otherwise. 


with peak at v = 1. 
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Example 2. If X and Y are i.i.d. Unif (-a, a) variates, find the density of T= X + y 
Solution. Recall that the m.g.f. of X ~ Unif (-a, a) is M(t : X) = (e" — e" уо д. 


M(t: X+Y)= M(t: X). M(t:Y) = (e" —e "y / 4a't? 
p) a А e” е2“ 
Tie. 4 A FIL UE ee ee 
= 7 |0а+ 2а) 0а 0) (0-2a)(0-2a) (-2a-0)(-2a ~ 2a) J 
This shows that X + Y ~ Trgl (—2a, 2a) ; hence the density of T= X + Y is 
glu) = (2а+и)/ 4a’, -2a«ux0; glu) = (2a —u)/4a’, Ü cus 72a. 
Note. The density of X — Y also follows as under. Thus, if X and Y are i.i.d. U(a, b). Then 


M(t:X-Y) = M(t:X)M(t:-Y)=(e" -e")x(e" —e")/[-(b—-ayt'] 
For brevity, put b — a — h, then 


2 \(h-0)h+h) (0-m(0-h Ch 2h 
This being m.g.f. of Trgl (—h, A); it follows that V = X — Y has the density 
g(v) = (v4 hh, -h«v«0; (у) = (А – у)/А, O«v«h. 
Remark. If the densities of X + Y and X – Y are both needed, then Jacobian method 
may be tried. 


ht Or -ht 
M(t: X-Y)s (e" -2+e")/h’t? = $ UE l| БЯ „.... chu 


Exercise 18(a) 


1. A r.v. X uniformly distributed over an interval of unit length is such that P(1/4 < X < 1/2) = 1/4. 


Determine the interval. [Ans. Undetermined] 
2. If X has the distribution : f(x) = 5/A, -A/10 < x < АЛО ; f(x) = 0, otherwise determine the 
constant A when P {1Х1<2) = 2Р(1Х1> 2}. [Ans. 30] 


3. (a) For the rectangular distribution dF = k dx, | <x < 2. 
Show : Arithmetic mean » Geometric Mean » Harmonic mean. 


(b) Let X.. 000, 1). Find Corr (X, Y) when Y= X,. [Ans. p= (61:3 /(n+2)| 
4. Suppose a string, | meter long, is to be cut in two at a random point, along its length. Let X be 
the point where cut occurs and let its p.d.f. be f(x) = 1, 0 « x < 1. 
What is the probability that the longer piece is atleast twice the length of the shorter ? 
5. If X be U(-a, a), a > 0 ; determine a so that 
(a) Р(Х> 1) =0.3, (Б) PX < 1/2) = 0.3, (с) (1XI» I) = Р(1ХІ< 1). [Ans 5/2, 5/27] 


6. If X is U(—3, 3), find k such that P(X < k) = 1/3. Also compute Р(Х = 2), P(X < 2 and 
P(1X-21«2). [Ans. 0, 5/6, 1/2] 
7. If X be U(a, 9) and P{3 < X <5} = 2/7, find a and compute P{ | X — 5 | < 2). Find also а real 
number r such that P(X > г} = 1/4. [Ans. a 22, r7 29/4] 


8. If M(t: X)= (е —e*)/t; t€ 0, M,(0) = 1, find Var (X) and P(4.9» X» 4.7). [Ans. 1/7. 0.2] 


4 
9, If X is uniformly distributed with mean 1 and variance 4/3, find P(X <0}. [Ans. / 


pow 


10. 


11. 


12. 


13. 


14. 


15, 


16. 
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If X and Y are i.i.d. U(0, 1) variates, find 


(a) Р(Х? < 0.5), (b) P(e^* < 0.5), (c) P(cos (пх) €0.5), 
(d) P(X +Y < 0.5}, (e) PIX -Y S05), (0 P(XY <05}, 
(е) P((X / Y) $0.5], (h) P(X? +Y? < 0,5). 


[Ans. 1/42, 1= 0n 2, 2/3; (9) 1/8, 7/8; (1+0n2)/2,1/4, 1/8 


On the axis n + I points are taken independently between the origin and x = 1, all the 
positions being equally likely. Show that probability that (k + 1)th of these points, counted 
from the origin, lies in the interval (x — (1/2) dx, x + (1/2) dx) is (n 1) "C, x" (1 x)" dx. 
Verify that the integral of this expression from x = 0 to x= 1 is unity. ) 

A point-size worm is inside a spherical apple x? + y. + 2 = 4a! ; its position is uniformly 
distributed. If the apple is eaten down to a core, determined by the intersection of the sphere 

` 2 А 
and the cylinder х + у =a’, find the chance that the worm will be eaten up. [Ans. 42118] 


The quadratic equation x! - ax + b = 0 has real roots X,, X» (X, > X,) and b > O is an unknown 
quantity that can have a uniform distribution in the permissible range of variation. Find Var 
(X,) and Var (X,). [Ans. с? = с2 = а2/72] 
(а) Both roots of equation x’ + ах + b = 0 can take all values from —1 to +1 with equal 
probabilities. Obtain p.d.f. for the coefficients a and b. 

[Ans. Ќа) = (2 - 141)/4, g(b) =-(1/2) bn |b |] 
(b) Leta and b be jointly, uniformly distributed over the quarter circle à! + Ib «1,a» 0, b» 0. 


Show that the probability that the equation x? + 2Ja x — (b — 1) = О will have no real roots is 2/r. 


(a) Find the probability that the roots of equation x? + 2bx + c= 0 should be real, given that 5 
~ U(-a, a) and c ~ U(-p, B) are independent. 

(b) In the equation x +2ax+b=0; aandb independently are equally likely to assume values 
in the interval [-1, 1]. Find the probability that the roots of the equation are real. 

Suppose that a, b, c are positive, independent variates with a common c.d.f. “F”. Show that 


the quadratic x^ + bx + с = 0 has real roots with probability E E "F(x? / 4y) dF(x) dF(x). 


Y 

17. If X is U(0, 1), then Y is N(0, 1) where X= (1/2)1 + (2/ 2x) f, exp (-£/2)dr]. — [Ans. 1/3] 
18. (a) If X - U(1, 4) find P(Y <0} where Y= X" - 4. 

(b) If X ~ U(0, 1), compare F( 1X - u! « kc) with the values given by Chebyshev's inequality 

for k = 5/4, 3/2, 7/2 and 2. -A 
19. (a) If X ~ U(O, 1), find the distribution of 1/X. Find E(1/X) if it exists. 

(b) If X is U(—n/2, n/2), find the p.d.f. of Y = tan X. y 

[Ans. (a) fly) =y 1 $ y « %, E(Y) — o, (b) Ln (1 + y] 

20. (i) If X ~ а, b), show that cX + d ~ U(ca + d, cb « d). 

(ii) If X is U(0, 1), show that Y = (b — a) X + a is U(a, Б). 
Ии x U(-1, 1), find p.d.f. of x’. Further, if X ~ U(0, 1), find the p.d.f. of 


УХ, X5, К! eX, ах, X/() 4 X), - X on (1 X), (A> 0). 
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22. 


23. 


41. 


- Letx,, X,, ...,. X. 


(a) Let X ~ UC, 1) and Y ~ U(0, X). Find the joint density of X and Y and the marginal density of y 


(b) If X is UO, 1) and Y is related to Xby X= |", fat, | „ FO=1, f)20, show that ji; 


is the density of Y. | bos RE 
Two independent variates are each uniformly distributed within the range —a to +a. Show that 


their sum X has a p.d.f. given by 

Дх) = (2a + x)l4a, -2а<х<0; Мх) = Qa- х)/4а 
Verify that the т.р. Ё. calculated from the value of f(x) is equal to [ 
„ be i.i.d. U(0, 1) random variables. If Y, ~ U(0, 1); Y, ~ U(0, У), ..., Y, ~ UCO, ¥,,_,), 
show that Y, = 1 eX X. Y X: pA. 
If Z is the number of Y,, Y,, .., Y, in[t, 1], O« t« 1, show that Z is Pois (-n 0). 


ПЕ х5 2a. 
(sinh ааг]. 


. If X, Y, Z, are i.i.d. U(O, 1) variates, obtain the distributions of iQ Y), and iQ +Y +Z). 


[Ans. $18-41] 


. Let X and Y be i.i.d. U(0, 1) variates. Define 


Z=X+Y,if0<X+Y<1;Z=X+Y-1,if 1< X+Y<2. Show that Zis U(0, 1). 


. Let X be a variate for which E(X) = p and Var (X) = c^. Further, let Y be U(a, b) variate. 


Determine a and b such that E(X) = E(Y) and Var (X) = Var (Y). 


. Let X and Y be i.i.d. U(0, 1) variates. Find the conditional expectation of (X + yy given (X - Y). 
. Let X ~ U(0, 10) and define Y by Y=X" if0<X <6, Y=3,if6<X<10. 


Find the conditional expectation of Y given 2 < Y < 4. 


. Let X,, X», ..., X, be a random sample from U(0, a) distribution. Find the c.d.f. of T= min (X, 


КУЙ [Ans. f(t) = (n/a)[1—(t/a)]""',0<t<al 


. If X and Y are i.i.d. U(O, 1) variates, find the p.d.f. of (i) KIN (ii) max (X, Y)/min (X, Y). 
. Let X and Y be i.i.d. U(0, 1) variates. Let U = XY and У = (1— X) (1 — Y). Find (i) the joint p.d.f. of U 


and V, (ii) the marginal distributions of U and V, (iii) the conditional distribution of U, given V- v. 


. Let Х|, X5, ..., X, be i.i.d. U(0, 1) variates. Show that the pid, ork =X, X, .... X, 15 


f(x) = (n 2i "Kn —1)!, 0<х<1;/(х) = 0, otherwise. 


‚ IfX,, X,, ..., X, апа Z аге i.i.d. U(0, 1) variates, find the p.d.f. ӨР Х,, ЖЕ, X IZ. 
. Let X,, ..., X, be mutually indep. variates ; X, ~ U(k, k + 1), k = 1, 2. ‚п. Find the p.d.f. of 


XK) +X, ++ X -n(n* 1)/2. 


. Let X ~ U(0, 1). For the variate Z, - А7 (X^- (1 - Xy], find D, and р, [Z, is Tukey's symmetrical 


lambda variate]. 


. Let X be a variate ranging over [0, 1]. If P(x « X < y} depends on the length y — x, for all 


0<x< y< 1, then X is U(0, 1). 


. Let X,, | <k <n be indep. variates such that X, is Ulap a,). If 1a, | « a and La; — oo; show thal 


Linderberg-Feller condition is satisfied and hence the C.L.T. holds 


. Let X and Y be independent variates such that E( | X |) < oo and Y is U(0, a). If Z= a ((X + "al 


then E(X) = E(Z). ( [k] denotes the greatest integer contained in k). 


. Let X bea non-negative variate of continuous type. Let [X] be Pois (А) and X - [X] be U(0. 1). 


If [X] and X — [X] are assumed independent, find the p.d.f. and variance of X. ( [x] is integer 
contained in x and x — [x] is fractional part of x). j 


Suppose (i) fx) = 80) HO), Gi) fx) = ceGOLT — Н(х)] where f. g are p.d.f's. and H is the -df 
of a variate with p.d.f. : h( - ). A variate Y is chosen from density А( . ) and an independent value 


X is chosen from density g( - ). Show that if x is acce ted iff (i ii then the 
accepted X has the distribution ft - ). E eos y> x. 
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EXPONENTIAL DISTRIBUTION 


18-60. Definition 
The continuous variate which is distributed according to the probability law 
Ах) = ле (A>0),0< x « 0; f(x) = 0; otherwise wit 


is called the exponential variate with parameter A, f is called the exponential density 
(function). Any variate possessing the p.d.f. (1) is expressed as X ~ Expo (A). 


Note. To treat mean 1/A (= В say) as parameter, sometimes density is written 
f(x) = (1/8) exp (—х/В). 


Comment. Some authors call (1) as negative exponential distribution. The term negative 
is really redundant since b ех dx o. 
Cumulative Distribution Function : 

F(x) = f Ae" dt=1-e™,x>0; F(x)=0, otherwise. 

F(k)  P(Xzk)-1-e *;P(X2k)-e ^ [Survival function]. 


18-61. Simple Moments. М.С.Е Cumulant Generating Function 


Bar = I(rtb .r! 

' s E(X) = | Ае " x' dx ———-—. 

н, (Хэ) = f, xIlIS 

Thus, pom 1/0, ру = 2722р = 5 и? 2VX. 


If follows that for Expo (А) : Mean <, = , > variance & А > =, < 1. 
M(t: X) = 1 (7А). [8 8-16 (13)] 

Characteristics Function : $(:X) = [1- (it) '. 

Expanding the Binomial expression involved in m.g.f. we get 


. а t E V r! LI !— ! E 
M(t: X) > (+) =) (2.5: > p, = 17А 


r=0 r=0 
= (AY 2 (т-1)!г 
Kit: X) = in M(t:X) - 10/0) X f E „у сиг 
k, = (r- DUX. [Coeff.of r' /r1] 
Thus, E o JA held deal idum Oho 


Pearson Coefficient, Median and Mode 

Since y = К 21/A, py =k, =1/22,p, =k, 22/ M, ba = hy + 3k =9/)^. 

^ B, = ni/pi24; В, - na / m2 59: = VB 2: v2 7B: 737 

h»0 implies that Exponential distribution is positively skewed and ү, >0 means the 
Е a is Leptocurtic. Note that the point ((B,, B2) lies on the st. line В, - B, - 3-2. 
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Median. If m is the median of exponential distribution then 


; 1 ; 
-àx “т — e" =, іе. m--—. 
: = "ле ах=1- е Е 2 À 


2 -Àx "mm s. 3 -Àt 
Mode. fix) Ae == е mf (x)= Ае 


ГО) = 0 = e" =0, which is not possible. Hence expo(A) possesses no modal value. 


18-62. Shifted Exponential Distribution (X ~ Expo, (A)) 
fix) = Ae?9-9. x20, 120; f(x) 20, elsewhere. 


M(t . X) Ll Ee углу g^ 9-9 е dy = Ae" i nay dy, [y ^ 0] 


= Xe does Se" [1— (7À ST. 


18-63. Memory-less Property or Markov Property 

A variate X is exponentially distributed iff it has no memory in the sense that 
РАБУ ЛАХ >»ЛГ="Р[Х > х| he Ore > 0: zd 

Proof. Firstly we observe that if X ~ Expo (A), then Reliability function or Survival 

function is 


R()eP(X» kh = [Ae de e 
P(X>x+hIX> hj = EAE LE en pry x) 
+ = OO — => = > . 
(X»x P(X»h] ow * 
Thus, X lacks memory in the sense of Eq. (1). A statement equivalent to (1) is 
P{X>x+h} = P(X»x) P(X» h). ...(2) 
Converse. We assume that (2) is true, and then show that X is Exponential r.v. Let 
R(x) = P{X > x} [R(0) = P(X > 0) = 1] 
R(x +h) = P{X>x+h} = R(x) R(h), [by (2)] 
"s R(x + - -R(x) R(x) A Z1] _ RW [R(h) – R(0)] 
h 
Let h — О to conclude that 
К'(х) = R(x) R'(0) or (dR/ R) = – Adx [A = -R'(0)] 


The solution of this differential equation is R(x) = Ae 
Since A = R(0) = 1, it follows that the distribution (i.e. anti-survival function) of X is 


Observe that R’(0) = —F'(0) < 0, which provides А > 0. 


Remark. Expo (A) distribution is a continuous analogue of Non-ageing discrete Geom (p. 
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18-70. Convolution of Exponential Variates 77 S 
Let X, ~ expo (А), j = 
sum) formula gives 


1 2 >] > > 7 - ^ "T . » - 
‚ 2 be independent variates (A, # А,). The convolution (statistical 


fux = fh fy ado ff X eM Ag ec 
Е xi f+ fio (1) 
Similarly, if X = X, + X, + X,, then 
ft) = ур су IO GS OGD 


The general formula for 5 = X, + X, +... + X, is 


Nias so vtm: gp dar Sn 
f(t) = $, та f(t) 


ud. AU olde DUST Эа 30-0. -À9 


The variate 5 = X, + X, +... + X, is called hypo exponential variate. 


N d А. Ài LUME À, E Е С 
E ad ria > (A, = A) i Oni tees ш? in (SY). 


Here C, , are not probabilities, since some of them could be negative. 
18-80. Relation between Exponential and Uniform Distributions 
(i) If X ~ Expo (A), then Y 2 e is Оп (0, 1). 

(ii) If X is Unif(O, 1), then Y = —(1/A) п X is expo (A). 


Proof. Here аР (х) = nae" dy 0<х<о0; put y=e ^ dy=-de™ dx, 0&x «o => 0<у<1; 
hence reversing sign 
dP,(y) = Ldy, 0s. y&1;, іе Y »D(0,D. 


-] 
Za E t 
M0) = Ee") Еее) ЕХ) n de = [1-+| = Ү-ехро 0). 
Comments. If X is shifted exponential [X ~ Expo (A): f(x) 2 Ae ^" 9, x20], then 
Y 2e 9-9 is U, 1). 


18-81. Distribution of Minimum of Expo-variates 
Let X i~ expo (A), 1 «i sn be indep. variates and Z — min (X, ..., X,). Then Z ~ Expo (ХА). 
` We have Z = min {X,, ..., X, nj: То obtain the p.d.f. of Z, fix a real number с > 0. Then 
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P{Z2c} = P(X,2c. X, 2 с, ig me) 
P(X, zc). P(X,2 с)... P(X,2 с} 


-Aye en a Ane “г (М tot hg dO 


(def. of min (x, 


= g 
This is the survival (or Reliability) function of expo (5%). Thus 

Z ~ expo (УА) and E(Z) = ИХ + À; + + А. 
Cor. If X,, X» ..., X, аге i.i.d. Expo (B), and Z = min (X,, =» X,) then Y = nZ is Expo (р) 
Proof. From (1), the elemental probability differential for Z, when = В, 1 sisnis 


ар (2) = пре" dz, 0«z«o. 
Let у = nz, so that dy = л dz, and this result reduces to 


арду) = ge" dy, 0<у<%о, = Y ~ Expo (f). 


18-82. Bevy of Worked-out Problems 

Example 1. If X ~ expo (a) and Y ~ expo (В) are independent then Z = min (X, Y} is 
expo (a + В). Further, if variate W is defined by W = | when X < Y, and W = 0 when 
X » Y, then E(W) = a/(a + В) and the variates W and Z are mutually independent. 


Solution. We already know that Z ~ expo (a + B). Now by Multistage E-Rule 
E(W) = E(1) P(X < Y) + E(0) P(X > Y) = Р(Х < Y). 
To find P(X < Y), use P(B) = У(Р(В | А) Р(А,) so that 


P(X«Y) = f PXsYIX2x)ae " dx [PY 2x) - e "'] 
E [7 ge et Pt quz —— 


acr 
Thus E(W) = a/(a + В). 
Example 2. Let X ~ expo (A). Find E[X | (X 2 1)]. 
Solution. I t< 0, (X21) =Q, 
n E(XIX21)  E(XI О} = E(X) = 1⁄4 
as E(X) is reciprocal of parameter A. 
Now let г > 0. Then, let B = (X 2 t} 


P(B) = P(X2t)= f, e" dx=e™. 
E(X I B) = E(/,X)/P(B). [def.] A) 
EX) = [7 lee РОО ах = X[^ xe "ax. 


Integration by parts provides 


x M 
za x -№ E ак -À | 1 
E(X) Mie "m | AM fara 
Substitutions into (1) give 
E(X|X2>t)=1+(1/d). 


————— 
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Example 3. Show that the minimal value of the set (X, ~ expo (À), j = 1, 2, ..., n} is 
independent of the (ranks) ordering of expo О). 


Solution. Let ji, J^, ..., j, be a permutation of set (1, 2, ..., n]. Now 
FIG Ga. SX | > | >; 
iat = Sen pre ek ye OAS: X min X, > x) Pimin X, > х) (1) 
і» PIX, <...<Х,) E 
where we used Reversal Identity 
P(A | B) = P(B | А).. P(A)/P(B). 
The memoryless property of exponential variates provides 
PX, <...<X, Imin X; >x}=P{X, <...<X,} AZ) 
Use of (2) into (1) leads to 
P(min X, » x1X, €«.. «X; ) 2 P(min X; >x}. 


Example 4. Two independent components A and B, each having Expo (A) distribution 
are found to be still operating at time 1, when their ages are a and b. What are the 
probabilities that (1) both will survive a further time f. (ii) that A will survive B. 


Given further that A does survive B, find the chance that B's age at failure was at most c ? 
Solution. Since components lack memory, the fact that they are, at time tọ, aged a and b is 


irrelevant. The future life-times X and Y of A and B have density 1e ^", (x »0); Ae”, (у> 0). 


Thus (i) and (ii) are essentially unconditional probabilities. 
(i) P(X»t, Y» t] = PX» 0.P(Y»02e?",  [F() 21-e?^] 


(ii) PX » Y) = f Ae" dy. [^ Ae dx 2 f e?" dy- 3 


y у 


x x 
U t 
The condition that A survives B gives D = {X > Y} as the conditioning event. We thus 
want the conditional probability 
P(Y < (c - band X >Y} _ P(E) 1 е206-% 


=e CO 
= — 


P(X»Y) 1/2 


© = -Мх+ у 1 1 
ог P(E} = P(D) - |7. з Jug M e Yt? dedy= 5 75e 


y=0 


РҮ <(c—b)|D}= 
-2A(c-5) 
Example 5. At a By-pass, the cars arrive at a Poisson rate of А per minute and buses 


arrive at a Poisson rate of и per minute. The arrivals are independent of each other. m 
that the next arrival is a car, find the expected value of the time until the next arrival. 
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Solution. Let X be the time until the next car arrives at the By-pass and Y be the time 


1 s | 
until the next bus arrives there. Then X - expo 9 and Y - expo ] are independent. 


Let T be the time until the next vehicle arrives at the By-pass and set 
A= (Next arrival at the By-pass is a car}. 
We need find E(T | A) = E(X | X < Y). Now 
P(X«tIX«Y) 2 P(X«t, X « YVP(X «Y] & И) 
We use conditioning : P(B) = XP(A) P(B | А); for continuous variates. 


P(X«Y) = f? PIX «Y WX -3)] fa) а= [; PY > 3) e dx 


А 
(A+ н) 


b: Utu OM dy} h e™ а= |е" dx- 
P[X <t,X<Y] = Р(Х < min (t, Y}], use conditioning 

= |? P[X « min (,Y)l X = x] fy G) dx 
f? P(min (1, Y) » XI X = x] fy(x) dx 


LPO >x). fa CO а= [не але" ах 


Ee 
A+ p 


= IN Ме" е^ dx= [155g 11071 s) 


Substitute from (2) and (3) into (1) to get 

P(XstIlX«Y) 21-29 *?' NO 
Result (4) shows that, given the next arrival is a car, the distribution of the time until 
the next arrival is expo (A + p). Hence 


E(TIA) = 1/(A + p); [reciprocal of parameter] 
Similarly E(T\A) = 1/%+и). 


Example 6. If X and Y are independent variates with a common Expo (A) density, find 
the p.d.f. of X — Y and identify the distribution. 


| LL [9 о до qz А 
Solution. Recall : (t)= f; е“ Ae di- — [X ~ Expo (A)] 
Since X and Y are independent, we have 
2 
$t: X-Y)s t: уф Р) - A. A. = A 


This is well-known Ch. Function of Laplace distribution [$ 8-16(13), и = 0] 
fu) = iX", (о «u « v) „(р 


Hence, by Uniqueness. Theorem of Ch. Functions, U = X – Y is Lap (A, 0). 
Comment. This problem shows how to obtain Double-exponential distribution (1:6: 
Laplace) from exponential distribution. 
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Example 7. Let X and Y be i.i.d. Expo (A) variates. Show that Z = min (X, Y) and 
D = max (X, Y) — min (X, Y), are independent. 


Solution. Here z = min (x, y), d = max (x, y) - min (x, yzix- yl; so 
M(t, t) = E(e^**^ Dye L Le me sion Pier. y) dx dy 
fje "fos y) dx dy + [[e*597 F(x, y) dx dy 


ГА v<y 


| 


Ш 


Hu JM We 


Cie АЕ 0 dx ду, [by symmetry P(X 2 Y) = P(Y 2 X)] 


FEY 


Putx - y = v, у = и; | A(x, yyO(u, v) |= 1 so dxdy = иа». 


О 


-| =] 
M(t,, t5) = (fr 26 ени) (J he a ей) = | x (i n = M(t,) M(t,). 


This shows that Z and D are independent; Z ~ Expo (2X) and D ~ Expo (A). 
Note. Use of Ordered Statistics disposes off the problem instantly. 
max (x + y)=5(x+y)+ 31x - yl; min (x * у)= 1 (x * y) - 10x - yl. 
Example 8. Variates X and Y are jointly distributed as 
Дх} =. Aue mU КЪ x30, уо. th) 


Show that X and XY are i.i.d. Expo (A)-variates. 
Solution. U = X, V = XY and put x = u, y = v/u. Then 


1 0 


-v/u) Mu 


OX, y) _ 
O(u, v) 


дх/ ди OxlOv| 
ду/ ди Oylóv| - 


ui 
и. 


Thus, dx dy = | l/u | dudv. The joint p.d.f. of U and V is thus, using (1) 
fx, y) = dx dy 21J | gu, v) du dv = X? ием *" | (1/u) du dy 


Le. g((u, v) = (Ae) (Xe ),u»0,v» 0. 

Thus, U and V are independent Expo (A)-variates. 

Example 9. Show that the exponential variate inherits the memoryless property from 
the geometric probability law. 

Solution. Recall : X is memoryless iff; P{X >a+b|X>a}=P{X>b} 

Le. iff: P(X»a-bjzP(X»a).P(X»b)J, Уа, Б> 0. 

Both geometric and exponential distributions obey this law. [$14-30 and 18-63] 
In a sequence of Bernoulli trials, the probability that the first success occurs on trial k 
is given by gem (р), i.e. P(X =k) = др „К = 1, 2, ..., so survival function is 


P(X>n)= Ура‘ = рд" (1+9+4 +...) =4' (0 - р)". 


К=п+1 
We now use Poisson Process as under : Suppose each trial takes time Ar to perform so 
that the n trials take n Ar time. We let n — oo, At — О in such a way that the total time 
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consumed remains constant, i.e. (n Ar) = t. (fixed). Now let p — 0 in such а way tha 
the mean number of successes per unit time remains constant. As such we may se 
p = AAt, where A is the mean rate of occurrence of the events. Then 
P(X > n) = (1 – р)" = (1 - АА) [1 - (At/n)] > e", as n > о. 

Thus, the probability that the first success occurs after time t is e. In other words, if 
l'is a variate denoting time until first success, then 

PIT >th=e™ —F()sP(Ts)2s1-(T»0)21-e" = є) = F(n2Xe",:20 
which is the exponential density to the effect that the first success occurs at time ; 


Problems with Solutions Provided at the End of the Text 


1*. Prove or disprove : If X and Y are independent, then 
(a) mode (X + Y) = mode X + mod Y, (b) med (X + Y) = med X + med Y. 

2*. The daily consumption of milk in excess of 20,000 gallons is approximately 
exponentially distributed with А = 1/3000. The city has a daily stock of 35,000 
gallons. What is the probability that of two days selected at random, the stock is 
insufficient for both the days ? 


3*. Let X ~ Expo (A). Find the value x, such that P(X > x,]/ P(X < x,] =a. 


4*. If X ~ Expo (A) with P(X < 1) = P(X > 1), find с>. 


5*. Show that Y = -(1/A) (n F(X) is Expo (A). 

6*. Let X and Y be i.i.d. Expo (A) distributed. Find the waiting time distribution of 7 = Y/X. 

7*. Supoose that the time until failure of some device has an exponential distribution 
with mean life-time of n months. If k independent devices are observed, find the 
chance that the first failure occurs within m (< n) months. 

8*. The time interval T between consecutive random events is Expo (A). 
(a) Show that the expected length of an interval is 1/A and find the probability 
that an interval exceeds this value. 
(b) Find the prob. that, of five independent intervals, exactly two are less than 
the expected value. 


9*, Independent г.у. X and Y have exponential p.d.f. f(x) = qe ^, (у) = Be? 0«x y «* 


Find the p.d.f. of X — Y. | 
10*. Find the transformation Y = H(X) such that if X is Expo (A) then Y has the p-d-t- 


g)-1y 7, OS yk g(y)=0, elsewhere. 
11*. Let X be a mixed variate such that 


137! e^. y > 0, x not integer 


СЕЕ nitet. d. x= 0/1, 2, ... 


0, otherwise 2(x!)' 
Find the m.g.f. for the variate X. Hence or otherwise find Var (X). 
12*. Independent variates X, Y,, Y), ..., Yy; N are such that 
Р(Х= т) = (е 1)" P(Nen)-(e- D Intm nz l2, 
Y, ~ U(0, 1). Show that Z = X ~ max (Y, Y,, ..., Yy) ~ Expo (1). 


pr ass 


13*. 
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In а sample of n random observations form Expo (A) distribution, the number ot 
observations in (0, 1/A) and (1/A, 2/A) denoted by X and Y are noted. Find Corr (X, Y) 


14*. Uncorrelated variates X and Y are jointly distributed with marginals X ~ Expo(a) 
and Y- Expo(b). Determine the joint distribution. 
Exercise 18(b) 
1. If X has exponential distribution with mean A, find P(X « 11 X « 2). [Ans. Ve /(1 + Ve)] 
2. If X ~ Expo (A), find p.d.f. of Y = log X and X = log Z. 


[Ans. Ду) = Aexp(y = Ae’); 8(2) = Ме *^, 22. 1] 


. The length of time (in minutes) that a certain lady speaks оп the telephone is a random 


variable specified by p.d.f. as f(x) = Ae ^, x 20 ; Дх) = 0, otherwise. 
(a) Evaluate A. What is the probability that the number of minutes she takes on phone is 
(1) more than 10, (11) less than 5, (iii) between 5 and 10 ? 
(b) Show that, for any two pos. numbers a and b; P(X » a « bl X» a) = P(X » b]. 
(Ana. Ax LS u^ Lore) (e 1/67] 


4. X~ U(0, 2) and Y ~ Expo(A). Find the value of à such that P(X < 1) = Р(Ү < 1). 

5. X~ U (-1, 3) and Y ~ Expo(A). Find À such that o% = су. [Ans. à = V372] 
6. X ~ gem (p) and Y ~ Expo(A). Find А such that P(X > 1) = Р(Ү >» 1): [A 2 0n (1 —p) '] 
7. If X ~ Expo (A) evaluate P{ | X - p | 2 ko] and compare it with Chebyshev’s bound. 


12. 


13. 


14. 
15, 
16 
17 


[Ans.1 -[(e* - 0) ек? 1), ba 1/ к] 


. Suppose X is Expo (A), and define Y by Y - n, iffn-—1<X<n,n=1,2,3,... Show that Yis gem 


(p) and find p. [Ans. p=1-e"] 


. Find the Ch. Function of Y = -ên F(X), where F(X) is the c.d.f of X. Also evaluate the rth 


moment of Y. [Ans. р’, =r!) 


Ру) = 2x.xe ^ ,x 20; show that Y= X? is Expo (A). 
. If X is Expo (A), find the distribution of Y=X/(1 +X). 


[Ans. (у) = А(1 – DE exp [-Ay/(1-y)],0<y< 1] 
If X and Y are i.i.d. Expo (A) variates, find the p.d.f of X+ Y, X -Yand EIX- ҮІ. 
[Ans. gam (2, A), Lap (0, А), Е121= А71] 
If X and Y are i.i.d. Expo (А) variates, find the p.d.f of 
(a) X? axes Чай, (d)X-Y (e) IX - Yi. 


[Ans. f, = ./3w?7" exp (-Àw'?),w»0, — fa = (4/2) expI-AQv - 9/2, w> 3: 


fy = (К/А)! exp (~Aw"),w>0, Л See(Q.12) f е“ t>0]) 
If X be Expo (1), find the p.d.f. of Y where Y=X, if X < 1, Ү= (ИХ), if X» 1. 
If X, Y, Z are i.i.d. Expo (A) variates, find P(X 2 2Y 2 34]. [Ans. 2/33] 
If X - U(0, 1) and Y - Expo (A) are indep. variates, find the p.d.f of (a) Y/A, (b) XY. 
If Xx ~ Expo (a) and Y ~ Expo (b) are indep. variates, find the p.d.f. of Z where ZzX-Yif 
X2Y;Zz0,if X«Y. 
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18. 


19. 
20. 


21. 


22. 


23. 


24. 


25. 


26. 


27. 


the p.d.f. OS EX tX t.. +X | 

1/nÀ. Hence find Е(М,). e 
[Ans. (1) [1 + (1/2) + (1/3) +... + I/n)} 
= P{ = [x]}, x > 0, where À =- бп (1 р): 


If X,, 1 <k € n, are i.i.d. Expo (А) variates, find 
M, = max (X,, ..., X,) show that E(M,) - EM,- |) = 


If X is N-B (1, p) and Y is Expo (A) show that P(X € x] 

[x] is the greatest integer less than x. 

Let Х|, X,, ... be a sequence of i.i.d. Expo (A 

gem (p). Prove that Y is exponentially distributed. 

Let Z= min (X, Y), where X - Expo (A) and Y - Expo() are independent. Show that 

(i) E(ZXIZ2 X) = 2/0. +p)’, 

(ii) Е(7Х17= Y) = (2/0. i ) + (1А, (А+ 1] 

(iii) E(XZ) = (25. + p)/A(A + р). Determine Cov (X, Z). 

Suppose X and Y are i.i.d. Expo (А) variates. Let U = min (X, Y) ; V = max (X, Y). Find the joint 

p.d.f. of U and V and hence show that U ~ Expo (2A) and V ~ Expo (А) are independently 

distributed. 

Let X and Y be two indep. №0, 1) variates. Let Z ~ U(0, 1) be independent of X and Y and define 

W=ZX+(1-Z)Y. 

(i) Find E(W) and Var (W), (ii) Find the conditional distribution of W given Z = z, (111) Find the 

distribution of W. 

Let X be Expo (1). Let X =x, take n independent observations Х|, X,, ..., X,, each X; ~ Expo (A). 

Find the conditional density of X given (Х|, X), .. Х,). 

Let F(x) and f(x) be the c.d.f. and p.d.f. of a variate X 2 0. Show that to the first order of magnitude. 
Р{х<Х<х+ахіх<Х} = f(x) ах! [1 — F(x)] = p(x) dx. 


у variates. Let Y 2 X, + X; +... + Xy, where Ni 


Establish : F(x) = 1 — exp (- fa u(y) dy). 

Deduce that u(x) = А (constant) iff X is Expo (A). 

If X is Expo(A), determine E [X I X « c ] by (i) Definition of conditional mean, (ii) Multistage 
E-Rule. 

Records of an insurance company reveal that : 

(i) There is a time lag between the reporting of a claim and its settlement : 


(ii) The frequency density function for the number of claims getting settled, out of an initial 
number N of claims, at a point of time in the vicinity of time t (in years) is Nke- "k>. 


(iii) The amount paid out as claim increases with the time lag between the reporting and 
settlement of a claim, the average amount paid out in respect of claims settled at time f beine 
e", c » 0. 

(a) Show that the proportion of claims outstanding at time г is E 
(b) Find the average amount paid in respect of all claims. 

(c) Show that the average amount paid in respect of the claims settled withi 


n the first ye?! of 
its being reported is k(e* — e^)/ (k — с) (e* - 1). 
How does this compare with the result of (b) ? 


Fear is the tax that the conscience pays to guilt. (George Sewell 


yeieileimieleielejeieieleieieierielmeeeeeeeeeleeteiereieie 


Try to walk through life instead of being dragged through it. 


More Continuous 


Distributions 


GAMMA DISTRIBUTION 
19-10. Definition 
The continuous variate X which has p.d.f. 
-Àx x*^! 
fix) = TG A>0, a>0, 0xx«o ; f(x)=0, otherwise 


is called a (general) gamma variate with parameters o and à ; fis called a gamma 
density and if X has this density we write "X is gam (a ; А) or Г(о; А). The special 
case A = 1 is the simple (or standard) gamma density and often written gam (a). 
When a =n is an integer ; gam (n, A) is called Erlang distribution. 


Comments. Another equivalent definition is cited as 

fo) = xt e /T(a).B%, a>0, В>0, x20. 
It is notated X ~ gam (а, B), although В = 1/4. Be careful about notations. 
Cumulative Distribution Function (c.d.f.) 

E): Lh f(t)dt t>0; F(x)=0, otherwise 


The c.d.f. (when A = 1) is called incomplete gamma function. 


^. 
~ 
——— — 
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19-11. Simple Moments 


Р Бет -Àx x x*^ 1 Р 12 bis. ware! ы N T(a FT) 
E(X ) = 5 NT A dx = туй dx — l(a) (Ayer 
Far) a! (r] 
- - a! = «(о + 1)... (a 4 r – 1)] 
Tey X | | 
This provides p', = mean = o/A, ш, = a(a + 1)/А2 and hence Var (X) = р”, - Wt = o. 
It follows that for a gam (a, A) distribution Mean <, = , > Variance < А >, =, < |. 


Note. For gam (a, B), E(X) = aß = product of parameters ; Var (X) = ap’. 


19-12. M.G.F, Ch. Function, Cumulants and Reproductive Property 


M(t: X) = [1-(t/A)}*; M (it: X)=[1-(@/A)]* [$ 8 - 16 (9)] 
Kr yan ey sa y €9- au FD 6 
r=1 r r=] Ж r! 


Thus, k,  a(r- 1) V X . [Coeff.of t/r! in K(t: X)] 
So, K = uj za/À, kj =p, = 0/22, k = р, 720/ X, К, 260 X ‚р =k, + ЗК = (бо. + 302)/ X. 


2 
Шз 4 H4 6 2 
Неа ==; =—=3+-, — ү m——— 
В, МЕ * В, 2 B Yi da Y2 " 


Since y, >0, the gamma distribution is positively skewed, and y, » 0 implies that it is 

Leptocurtic. Obviously, the point (В|, B,) lies on the st. line 2p, — 3B, — 6 — 0. 

(ii) If X, 1 <k < n are indep. gam (A ; ot) variates, then (X, + X, +... + X,) ~ gam (A ; Xo). 

Proof. Since X, ~ ват (А, а,), M(t:X,)=(1-t/A)™; so 

M(t: S,) = Mt: Х +X, +... + Х,) = M(t: X). M(t: X,)... M(t: X,) [X; аге indep. variates] 
= (1-r/A)™ .-t/A) ? ...(0-t/3) ^* = [1 (€/2)] 2, (a = Ха) 

Since m.g.f. uniquely identifies a distribution, it follows that S, ~ gam (A : Ха). 


Sum of Exponential Variates : If Х|, X», ..., X, are i.i.d. Expo (A) variates, then 
S, =X,+X,+..+X, is a gamma (n, А) variate. 


Proof. For X ~ Expo (A), M(t: X) = [1 - (ИА). Now 
M(t: S,) = M(t: X, + X, +...+X,) = Mt:X) M(t: X,)... M(t: X,) =[1- (t/1)]" 
as X, are i.i.d. Expo (A). This shows that 5, ~ gam (n, A) variate. 


19-13. Limiting Distribution 
Let X ~ gam (о, A). Then as a A oo (wans À remains constant), X* — №0, 1). 


Proof. For gam (о, А), н = QJ/À, С ? = a/A2, M(t: X) = [1 — (t/A)] ©. Now let 
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X-(a/A) АХ | 
= УТД DB - Ja [Normalized gamma variate] 


Mat: Z) = Мг: Аа)? X- Ja]- e Mata”? : Ху= e" [1- (67 Va)) 
InM(t:Z) = -tva -a ün[1- (r/4a)]» -tva +a [(t/Vo) + (12/20) +...]= 11° + O(1/ Уа) 


lim (n M(r:Z) = $t 2 5 M(t:Z)=e'” [Un function is continuous]. Thus Z is N(0, 1). 


19-14. Mean and Variance of a Truncated Gamma Distribution 


If X is gam (A, n) i.e. f(x) = A" e™ x^^  /T (n, п> 0,), > 0, х > 0, we truncate it and find 


its probability density in a € X < b. Recall : Incomplete gamma function 


y(n,8) = f E potige 2. (1) 
Ї 0 sa y (n А y= 9 үт Tint D +“ 

=й th Un ж d cet id гу ar 2 Е | 
f fx) dx.= = da €. 1 dy =ar |h м | y". ду = ү(п, Ab) — ү(л, ^a) 


Thus, the p.d.f. of truncated gam (n, А) 
g(x) = AM e" x" /T(, a<x<b. {A =[y (n, àb) -y (n, Aa} 


I: Pp Get)” A, a E Jee ay 
EU eL xg) а= ту a A CES 
br Lor) yarn Ab) — y (n+r), Aa) о) 
XTn) ТА) — y(n, Aa) 
ET п or À (n + 1, Aa) Eo? шый! y (п + 2, 3b) - (n 2, Ха) 
E00 = A7 (a,b) 10.32) ouo dus yon yada 


So Var (X) = - )- E^(X), is instantly obtained. The incomplete gamma function in 
(3) can be reduced by reduction formula [1 (ii)]. However, the final result is not elegant. 


19-15. Worked-out Problems 


n EL 
Che 


Example 1. Prove that : "een wet 
ts 


Hence write down the relation iube. the distribution function of a Poisson and a 
gamma or X -variate. 
Solution. The series PNR: is os F(n) = P(X € n) where X - Pois (A). Now 


£ PIX < Gat узу X Lnd -E 
EC an Ў, ei т бе 19-01 Л 


The extreme member is а Telescopic series and boils down to е^" /п!. Thus 


DP{X <n} = —e?»' Inl, [р= 414] 
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Integrating this result between 0 and A, noting F(n) = 1 when A = 0, we get 
=f n 


o € і 
sl- pe -dr- x | e—— dt. eti 


42) 


Е(п) – 1 = 


This is the result dx Note that, during integration, we bo changed dummy } to 
dummy f. 


Alternatively, this result can be written as P{X <n} = 
It follows that Poisson distribution can be evaluated from the incomplete gamma ines 
and vice-versa. 

Example 2. If X ~ gam (r, А) where r is a positive integer, show that 

r-1 47M (Ay) 
Fa) = 1-5 £09 
j=0 J: 
Solution. Evaluations on integration by parts provide : 


[те а = =(-%—)- of =) - e™ (1+ Ax) 


P(Y >A} where Y ~ gam (n + 1, 1) 


ES E 2 pum - Ax 
тоо ае) ett 
pore as +302x2 + 6x +6) =— (rec BY Un. ) 
Thus, by TON Induction 
а kte™ k 
kig t= TN [ fe 7-41 [Таке k= r – 1] 
sae -M аш r-l ey 
So omrand edi an penale Иа Ыг 0). ог Ку (х)=1- 5 (7D 


where X ~ gam (r, А) and Y ~ Pois (Ax). The stated result is established. 
Example 3. Using C.L.T. show that 


e x 3 T wre di we 
no ло xa 3^ m 0 tn ty pi? 


Solution. (i) Let Х|, X», ..., X, be a random sample from Pois (1) and put 5, = X; + ^ 
+... + X, Then 5, ~ Pois (n), so that E(S,)=n= Var (S, ). 


Consequently, $* = (S, – п)/{/п. Ву C.L.T., as n => о, Z = $* tends to МО, 1) distributed. 
Now P(S, =k) = e"n'[k!, [S, ~ Pois (n)] so that 


P(S, <n} a P(S, =k) = Jb (n* / k!) (D) 
е =0 
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" 5 = ж « " 
Also PIS, Sn} = pi «o = р |5; <0} and S' ~ N(0,1) for large n. Hence 
n 
| А 0 І | " 
lim Р{5; <0} = f. fejd i f(t) : Normal density. „147 
LL LEM 
Thus, lim P(S, <n} = lim У T => [Бу (1) апа (2)] (2) 
no n9 L0 ! 


(ii) Let X,, X», ..., X, be a random sample from Expo (1) and put 7, = X, tX. + a3 
Then 7, ~ gam (n, 1) by Reproductive property. E(T,) = n = Var (T,). By CL... 


lim piss [уа [сһ 0] 
=; 2 = t Г se x = 
noo | Jn ~ Ка FOROR 
КОН ен miim £2 42. ууш =1- = limp Cy ЕР jes TY 
noo MZ À п» “9 Г (л) NS pa 2 noo 0 (n = 1)! 2 C 


We combine (3) and (4) to get the stated result. 


Problems with Solutions Provided at the end of the Text 


1*. Consumer demand for milk in a certain locality, per month, is known to be a 
gamma variate. If the average demand is a litres and the most likely demand is b 
litres (b < a), what is the variance of the demand ? 


2*. Find the p.d.f. of X if the random variable X is such that 

EX") = (n+k)!k"/k!, п= 1, 2, 3,...[k is pos. integer] 
3*, Show that if X is (p, o^), then Y = (X — u) /2A.6? is gam (1/2, A). Hence find Var (Y). 
4*. Show that the mean value of positive square root of a gam (r, А), variate is 


Г( + RLY T(r). Hence prove that the mean deviation of a N(p, o^) variate from 


its mean is с./2/л. 

5*. Let Х|, X, be a random sample of size 2 from Expo (А) distribution. Show that 
Y, z (X, + X) and Y, = X,/(X, + X;) are independent. 

6*. A random sample of size n is taken from a gam (m, 1/а) distribution. Find the 
distribution of X. 

7*. A random sample of size n is taken from Expo (A) population. If X is the sample 
mean, show that nA X is gam (n, 1) and that S.E. of X is I/A Vn. 

8*. Derive the m.g.f. of shifted (i.e. truncated) gamma distribution whose p.d.f. is 

е9) (х – Ө)! 


U.2O A0. >; 
T(a)/(A)* 


f(x) = 
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OIE: sion аа 


oF, 


12. 


13. 


. Let fix,0,n= > 


if Xi, Xx X. is a random sample of size n from a shifted exponential distribution 
Dap na 


[a = 1], find the sampling distribution of Xx 


If X is gam (a, A), show that P{X > 20/1} < 2/0). 


Ехетсіѕе 19(а) 


Let X be gam (a, À). Show that mode X = (a — 1)/А, if > 1 and mode X= 0, ifa < 1. 
Show that for gam (a, A) distribution 


6 
Mean -Mode _ ! .lP!5. Excess of kurtosis = =" 
3 


S.D. alge, 283 


ә B. E. 2 o: 24. 9 
. (a) If X and Y are independent M(O, 1) variates, find the p.d.f. of (i) X , (ii) X + Y , (Ш) ХУУ. 


(b) If X ~ gam (1 +A, A), show that P[O « X € 2 (1 + ))] » A/(1 +A). 


. Let X have a p.d.f. f(x) = ох? e ,x>0; f(x) =0 elsewhere. Show that T= ~ mX? is gamma 


variate. Hence show that 2bT/m is gam (3/2). 


r-]) E k-1 
[(1 15 КӨ) х] Кк exu + КӨ) х – К], х> 0, г = 2... ад |у. 


КЕН k! 
Show that f(x;0,r) is a p.d.f. of some variate X. [called Lagrangian gamma density]. Find 
Var (X) and M(t : X). Show further that E(X’) =n (1 +0)+(r— te i2 
E(X’) = (1 + 26) (In (1 + 20) -n (1-0)) + (r-2)! -E(X ) ; 23. 


. If the conditional distribution of Y given X = x is Expo (x) and the unconditional distribution 


of X is gamma with parameters a > 2, А > 0, find the marginal density of Y and its mean and 
variance. Show that the conditional density of X given Y = у is gam (a + 1, À + y). 


. A two-dimensional random variable (X, Y) has the joint p.d.f. 


Ах, у) = [FO Fon! x"! (у х)" e1, 0<x< у<90; f(x, у) = 0 elsewhere. 


Show that the marginal distributions of X and Y аге gamma distribution. Find the distribution 
of Z= Y - X. Show that Z and X are independent. 


. If X and Y are independent gam (0, A) and gam G +0, Ш) variates, show that the variate 


Z= 24 XY has gam (2a, JHA) distribution. 


- A random sample X,, ..., X, of size n is drawn from gam (о, ^) distribution. If X is the mean of 


the sample, find the distribution of nX. Hence or otherwise find its variance 


- Let X, 1 S < n, be a random sample from a gamma distribution. Show that 7/S and 5 are 


independently distributed, where $ — EXT Ya, X, and a's are real numbers. 


‚ Let X be a non-negative continuous variate, and let Y be U(0, X). If Z= X — Y, then Y and Zare 


independent if X is gam (о, 2) for same a > 0. 


The distribution of a variate X? is gam (a) if the densit ; "P 2 
y of Xi = i (-ax ), 
where A(x) + h(-x) = const. V x. S g(x) = h(x) LE xl exp 


Let X ~ gam (a, А). Find Corr (X, Y) where Y + X". 
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BETA DISTRIBUTION OF THE FIRST KIND 


19-20. Definition 
The continuous r.v. X possessing the p.d.f. 


x^^! (1 А. gy 


T 
Ax) B(a, b) 


,a,b>0, O<x<1; f(x)=0, otherwise 


is called a beta-I variate with parameters a and b; f is called beta density and if X has 


this density, we write it as X ~ B; (a, b). 
Remarks. (i) If a = b = 1, f(x) = 1 so X ~ Unif (0, 1) 


d 0.2 0.4 0.6 0.8 1.0 X 
(ii) If a = 2, b = lora = 1, b = 2, the triangular distribution results : 
2(1- x), 0<х<1 : je AX; О< хє] 
ХӘ = К otherwise ' f(x) = m buhedwdsé 


Distribution Function : 


LES Oeo v ; 
p ey п АЕО ОСУИ ИИ) =O, x«0F(x)z1, if x21. 


F(x) = Jo B(a, b) 
The c.d.f. is also known as “Incomplete beta function". 


19-21. Simple Moments and Moments Generating Function 


' | fs 1-3) n 1 | а+п-1 Ь-1 
B, = E(x") = f, ар. "бк dx = B(a, b) 3 " (17x) dx. 


ELEM Даз азо TD) 2188 il D Etn- D 
B(a, b) I(a T(a+b+n) (a+b 


а(а+1) , _ a(a+1)(a+2) 
c(c+l)’"?  ec*D(c*2) 


i.e. 


"n 
a+b 


H, = 


vee = ‘ul = 
ate a+b]; p3 


as a(a + 1) (a + 2) (a +3) A ae i ^ i 
ғ: =P (+2) (+3) 1° ш — ш =аЬ/с (с + 1), 


M ER, 
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Qab(b-a)  , . 3abQc + ab(c~ 6) 
Рз 7 с(с+ 1) (c2) t ct (с+1)(с+ 2) (с +3) 


мр рзд нй ОВАЗ Ас + abc — ба) 


а es жий. В `+ 3 
Er МЛМ И 
Тһе harmonic mean H is given by 


1 I(a-b) Г(а-1) ete | ias. 
H Tia) Tato- a a-y g=] 
The parameter c = a + b is often called “concentration parameter”. 
M.G.F. We use Taylor Series expansion for m.g.f. to get 


2 » T(a«b Г(а+х) ғ" 
Medusae DES O ui 


This result is of little use. 


! 


=н 


19-22. Mean Absolute Bevtotióh (M.A.D.) about Mean 
M = ElX- ul» У 00) (х-и) + X fo)(- х) 


x» x«t 


= E(X-p)= У /(х)(х-н)+ ZIMA H) 


x>p 


Subtracting : M = 22 f(x)(p- x), x«y. Substituting for ES 


1 1 s = 
5 Bla,b).M = uma ux) dr, ==] A) 


Let (rn = л) х 3"! dx, ... а р) EI "dia .(Q) 


We rewrite (2i) as 


x t fex hPa! dy = jas а( 1—3)7 dx - tJ' — K, say (3) 


K= fx" 0-3)! dx [Integ. by Parts, put А = 1 — u] (4) 
E Б. 


T ENTE NEST TRE UE č | 
Thus, K= yJ' — (n^ 3^/c); substituting for K in (3) gives (t — 
dJ 


dt 
J-A t—p’ 


a 3b fe 
ШШ” 2 J - A. (A=p RO 


J-A 
integration pr ——— = i 
8 provides Tn a constant (independent of t). 


If t > ^5 J d = = a 
HJ) > A ; ie. J(u) 2 A = рус This evaluates (2). Thus from (1) and E 
M = 2499. 2y*» 2a" p^ 


B(ab) cB(abj^ 


——— c 
(a + b)**^*'! B(a,b)' 


$19-24. Generalized B,Distribution of 9 


19-23. Modal Value of beta-I Variate 
Let y = fix) = (Ва, D] La, Gere I. "y 
We first note that if a « 1, then f(x) > o as х > 0 +, so x = 0 is modal value. If b < 1, 


then f (x) лака = l — Le. x = 1 is mode. If both a < 1, b < 1 hold, then the 
distribution is bimodal with modes at x = 0 and x = 1. 


Ifa =1, b= 1, then Дх) = 1,0 <х<1; еасһх e (0, 1) is mode. 
Ifa = 1, b» 1, then Дх) = (1 – х)? "VB, b = b(1- х)! O< x <1. 
Obviously, f'(x) < 0, so f is decreasing over [0, 1], hence х = 0 is the mode. 
Ifa>1,b=1, then f(x) = x""'/B(a,l). =ax*', 0<х<1 
Obviously, f'(x) > 0, so f is increasing over [0, 1], hence x = 1 is the mode. 
Now let a» 1, b» l, c= (a + b) > 2. Take logarithms in (1) to get 

(п y = -ln В(а, Б) + (a - 1) п x * (b— 1) 0n(1— x). 
We differentiate it twice w.r.t. *x" and obtain 


а) (УЧ у: 


у у = 
КУ тун Јас (р-р хур (х0, x1) 
Now y'= 02 (1-х) (a-1)=(b-1)x 2 х= (а- 1)/(с- 2). wih) 


Whon 9, y" «O0, (a> 1, b» 1) hence (2) gives the modal value. 


19-24. Generalized B,-Distribution 
The continuous random variable X which has p.d.f. 
a-l h-1 

x-m М-х 

faye (cm M-ati 
|. (M-m) B(a, b) 
is called the general beta distribution of the first kind. It is easy to verify the following : 
ha S s h? ab 


m<sx<M,a,b>0;  f(x)=0, otherwise 


, 


, [cz a* band h = M – m]. 


Lai Rodi oan 
Mode = 20-9. Coeff. of Skewness S, ара. 
We may also observe that : P{p< X <q}= m 5 f (х = Qr n 
Puty 77, usi, y- I so h(1— y) = (M - x) to recover 
PipsXsq = gig xc EE E l T O 4j 


B, [(a, Б) – B, (a, b)]/ B(a, b) 


Where B, (a,b) = fo y^! (- yy! dy. [Incomplete beta function] 


Note. BO (a, b)/B(a, b) = P(X < Ө} is beta c.d.f. or in-complete beta function Ratio. 
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19-25. Worked-out Problems 
Example 1. Let X ~ gam (a, X) and Y ~ gam (b, i) be independent Show that 
(i) U 2 X + Y, V = XX + Y) are independent, U is gam (a + b, X.) and V is B,(a, b) 


(1) Х= К sin? Ө, Y=R cos’ 0, O« R« c, 0«0 < 7/2 emply that R and Ө are independen 
Solution. (i) Let u 2 x + y, v = xx + y) then x = uv, y = ull =v) 
O(x, y) дх{ди Oy[Ou| |у l-v 
J = - —] ==. " m ] ty 
д(и, v) Ox/óv ðy/ðv| |u -u u. Thus, dx dy = | u | duc 


The region x > 0, y > 0 transforms to the region u 2 0, 0 < vy <1 in the u-v plane 
Since X and Y are independent, their joint probability element is 
dP (x, y) T" Kast? x^^! y! "жы аы: dx dy, K = [I (a) ro» (A 
In terms of (u, v) this reduces to 
a*tb -ħu ,a*b-1 a-l b-1 
e wu du v^ (1—-у) dv 
Р ё г сну Кие = dF (u).dF,(v),(0<u<0,0<v<l) .. (1) 
ар, (и, v) Tab) Bab dF (u) .dF,(v), (0 <u y (1 
This result shows that U and V are indep., U is gam ~ (а + b, à) and V is В, (a, b). 
(ii) Herex=r sin? 6, у=? cos’ Ө, Ax, y)/0(r, Ө) = - 2r sin 0 cos 0 
dx dy = 2rsin0 соѕӨ dr 00. 
The joint probability element (A), when converted to variables r, 9 gives 
dF(r, Ө) = KA+” e (ry! 2 (sin 0)? (cos 0y7^-? 2r sin Ө cos Ө dr dO 
E ar gre om dr (sin Ө)2“ 7! (cos Ө)?” ! 9 "n 
= oa Sorte. 7 ЙЕ dð, O<r<m, 0<0,n/2 
This result shows that R and Ө are independent, and А ~ gam (a + b, А) and Ө ~ B, (a, b). 
Example 2. If X ~ B(a, b) and Y ~ gam (a + b, A) are independent, then XY is gam (а, А). 
Solution. Let и = ху, у = х so that x = у, y= ulv. Then dx dy =| J | du dv = y du dv. 
The region 0 < x < 1 and 0 < y < % in the x-y plane transforms to the region 0 < и < =, 
О < v <1 in the u-v plane. 
Since X and Y are independent their joint probability element is 
х“ (1 Fa dx Сагон D gv, uim (1 5 yy! peed ui du dv 
B(ab) — r(a«b)/Q)'*" Г(а)Г (b) 
We integrate out v to get 
yer pert anu) (1 TS | | | 
dF(u) = === 1-1 — — 
(u) Taro Lg > 2 Put z : | 
gach yi?! e du [e E КА pe qarb ubl (e r(b) 
T (a) F (b) M T(aQ)TF() (А) 
i.e. dF(u) = {Ае и! /T(a))du, 0«u«oo. This shows that U = XY ~ ват (A; 4): 
N.B. Mellin Transform is also applicable. 


dP = 


$19-31. Simple Moments and M. С.Е 577 
Problems with Solutions Provided at the End of the Text 


1*. The duration (dur) for a construction project for completion is assessed as under : 
min dur. = 6 days, max dur. = 12 days, expected dur. = 8 days. 


The Coeff. of variation of duration is 10%. What is the probability that the 
construction project is completed within 10 days ? 


2*. IfXisa B, variate with mean p and concentration parameter c # 2, find its mode 
m and verify that : m — p = (2p – 1)/(c - 2). 
What is the least upper bound for | m — р 1 if p varies and c remains fixed ? 
3*. If X is Ву (a, b), then Y = 1 - X is B,(b, a). 
4*. Let X ~ B, (a, b) and Y = B, (р, q) independent variates. Show that XY ~ B; (р, b + q) 
provided p + q =a. 
BETA DISTRIBUTION OF THE SECOND KIND 


19-30. Definition 
The continuous variate X possessing the p.d.f. 


x^^! 


КЕС; 
i B(a, b) (1+ х)“*” 
is called a B,, or beta prime variate, with parameters a and b; f is called B,, (a, b) density. 


а>0, Ь>0, О<х<о; f(x)=0, otherwise 


Note. The two kinds of beta distributions are essentially the same. These are designed 
to cater for the ranges [0, 1] and [0, œ [. 


EI NE) 

1-х а а |e at 
z^ ! dz 
| a= b-1 dx 
ПРИ m a gr: 


Distribution Function : 


tt! dt 


p a,b»0,0«x«o; F(x)=0, otherwise. 
pa B(a, b) 0 yes) ee 


F(x) = 


19-31. Simple Moments and М.С.Е 


atn-1 
nw a ! x" dx x dx _ В(а+ n, b — n) 
Im р а. ате B(a,b) Bab Таа" "?  B(a,b) 
= T (a n)F(b - n) F(a) F(b) a"! / (b п)!" сар 
Tus 26 ud „ы cab kd a(a + 1) (a +2) 
с = = ш Ha = G1) b-2)’ Hh = тр 19062) (06-3) 
TS a(a-1)(a-2)(a-*3) . р, =p) - pi? = a(a * b 1) 


(b= 1) (b— 2) (b— 3) (b- 4)’ ~ (b- V (b = 2) 
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The Harmonic Mean H is given by 
Dx Ө, ре), b . H=% | 
E "a7 Paro "T be b 


, 2 TI(a*r)FP(b-r)t 


= t 
M(t) = mno A ta LÀ дыл lg By Taylor's series of m.e f) 
v) D КЕГІ 1+ 2. F(a)T(b)  r! [Бу Taylors series of m.g.f j 


This result is of little use. 


19-32. Formula for Ratio of Two Independent Gamma Variates 
If X ~ gam (a, А) and Y ~ gam (b, i) are independent variates, then (X/Y) is By (a, b) 
Proof. Let u = xly, v = x, so that x = v, у = vlu. Also 


A(x, у) дх/ди Ox/[Ov| | 0 1 
O(u, у) ду/ди ду/ду| |—v/u? Џи 


Thus, dxdy = (у/и?) dudv. The region 0 < x « o, 0 « y « © in the x-y plane trasnforms 
to the region 0 < u < œ, 0 < v < o in the u-v plane. (Draw Figure). 


Since X and Y are independent, their joint probability element is 


y 
2' 
u 


-ìr a-l -Ày .b-1 
dx.e7y dy +b Q-A(x* y) ,a-1 EE - 
аР(х, y) = SC ЛАА. et ig ta is dx dy, |K" =T (a) T(b 
Tern -FUIX y ya pr 


i.e. dP, (u, v) = Knot? еМ + 0и] yt]! y ^^! dudv 


By integrating out v we get 


a+b o a+b a+b 
ш ч -A(- u)u d uin ЛҮ Kx du (a+ b)u 


dF(u) = e i 
( ) 0 ye?! gt ET ** 
\ и ^ du 
ie. Ќи) аи = О<и< ©, This shows that U ~ B (a, b). 


B(a,b) (1 - uy*^' 


19-33. A Special Worked-out Problem 
Example : Let X ~ gam (a, X) and Y ~ gam (b, A) be independent variates. Let 


k X X КАУ 
ии, Шы mates GREF 
yo Ie oe Masry 


Show that Z is independent of each of U, V, W and find their p.d.f’s. Deduce that 


(x) . E00 . g(X-Y) EQ0-EQ 
X «Y E(X) - E(Y)' X+Y) EQOO«EQ) 
Solution. The joint distribution of X, Y is 
dF(x, y) = М Оху de MeO dy ы -0 


Г (a) І Г (b) 4 
Let x = r cos? Ө, y = r sin? Ө, so that 0 < r < oo, 0 < 0 < л/2 ; also 
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MM 


O(x, y) 
alr, Ө) 


The joint distribution of the new variates R and 0 is thus 


Cer TLF E LT өө 
[ (a+b) 


cos? 0 sin’ 0 
—2rsinO cosO 2r sin O cos 0 


2r sin Ө cos Ө 


1F(r, = н 2 
dF(r, Ө) | Ba, b) (2) 
It follows that R(=Z) and 0 are independent, and since U, V, W are function of 9 only, 
we conclude that Z is independent each of U, V, W. Obviously Z = R - gam (a + b, X); 


0 ~ B,(a, b). 


dF(0) = 2cos^^! 0 sin^"^' Ө 40/ Bia, b) ...(3) 


(a) Set: и = х/у= соі? Ө, du=—2cot Ө cosec? Ө d = — 2(1 + и) Vu 40 


In terms of и, (3) reduces to 


2a-1 
? 


2 u п аи и“! du 
аңы) = Fem its) (т) cer rime TP hs SS 
Thus U ~ By (a, b). 
(b) Set: v= x/(x + y) = cos? Ө; dv = – 25іп Ө cos Ө 40 =-2Vv J1- v 49. 


In terms of v, (3) reduces to 
2 еа)! T my dm ГЕЛ tq s att 
dFO)= Bb. jmWeckre es 2 Ba” 
Thuu V ~ B, (а, b). 
(c) Set: w = (x – у)/(х+ y) = cos 20, dw=-2sin20d0, [1 + cos 20 = 2 cos? 0, etc.] 


О <у<1. 


In terms of w, (3) reduces to 


2а-1 24-1 


dF(w) = yos (cos? 8)?^- ^? (sin? 0)?" dü- z Е 5 ES e xm) 
fyw) = Led! Св -I<wsl. 
Now E(ZV) = E(Z)E(V) => E(X)=E(X +Y)E[XAX+Y)] 
E(ZW) E(Z)E(W) = E(X-Y)- E(X * Y)EK(X - Y)(X *Y)]. 


These are equivalent to the results stated. 


Problems with Solutions Provided at the End of the Text 
l*. Show that, to each B,-variate corresponds a pair of By variates and conversely. 
2*5. iron gam (a, A) and Y ~ gam (b, A) are independent, then the variates 
И = X + Y, V = Х/Ү are independent, U ~ gam (а + b, A) and V ~ Ву (a, b). 
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3*. Random variables X and Y have joint p.d.f. 


fix, у) = 24xy, x »0, y»0, x+ysl; f(x, у) =0, elsewhere 
Show that U = X + Y and V = X/Y are independent B, and В,, variates 


Exercise 19(b) 

1. Let X be a B, variate with E(X) = 1/4 and Var (X) = 1/8. Find the values of the parameters of X 

What it is modal value ? i 
2. Let X be B, (a, b) and put c = a + b. (i) Show that if a > 2, b > 0, then 

E(x") = ezh ee I EN 
а- 1 (a - 1)" (a - 2) 

(11) Find the density of X^! and (1 - Xy/X. 

(iii) Express E[X/(1— X)] in terms of c and и = E(X). What restrictions are required (on и and с) 

in order for the formula to be valid ? 

(iv) Can E(1/X) be unity ? 
3. The variate X has the p.d.f. : f(x) = ax I1 + 2x5), x20 ; f(x) = 0, otherwise. 

Find a and show that Y = 2X/(1 + 2X) is a B,-variate. 


4. Let f(x) = a^ b" x^^! (b+ axy ^^ ^/ Bla, b), x > 0; f(x) = 0 elsewhere. Show that 


p 2 
E(x’ = (2) T'(a * r)T( -7). n- b^ (a+ b —1) i _ b(a-1) 
Pd ET ae pues: abr) 


Hint. f(x) = 2^x^^! (1-- Ax) ^^ ^/ Bla, b), X.—a/b. To find E(X"), use Ax = 2. 

5. Show that the mean value of the positive square root of B, (a, b) variate is 
I (a 4 1).T (a » b)/T(a) (a b * 2). 
6. Let X be B,(a, b). Suppose /, (a, b) = P(X < х) is the c.d.f. of X, and write 
B,(a,b) = jj i^ q- 0^! dr. 

Now establish the following : 

(i) 1, (a, b) = B, (а, b)/ B(a, Б). (ii) 1, (a, b) 2 1— I4. „ (b, a). 

(iii) 1, (a, 1) =x", 1, (15) =1- (0 - x}. 

(iv) (a + b) I, (a,b) al, (a+ 1,b) + bI, (a, b + 1). 


(у) xI,(a,b) - I, (a+1,b)+(1-x)1, (a+1,b-1)=0. 


7. (a) Suppose X ~ gam (à, a) and Y ~ gam (A, b) are indep. Show that U = X + Y, V = (X - Y)/(X + Y 
are independent variates. 


(b) Let f(x, y) = etx? y* /T(4)F(5), x > 0, y > 0. Find the p.d.f. of U = X/(X + Y). What is 
Var (U)? 

B. If X - B, (a, b) and Y ~ B, (a + 1, b) are independent, show that /XY is B; (2a, 2b). 

9. If X ~ gam (a) and Y ~ gam B,(b, a — b) are independent variates, find the p.d.f. of W - XY. 
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10. LetX,, X», ... X, be independent В (а, b,) variates. Suppose d; = ау + bpp i=l, 2, 3,..., k - 1. 
Show that Х|, X^, dee Xm B,(a,, b, + b, +. + b,). 


11. Let X - B, (a, b) and Y ~ Bi; (p, q) be independent variates. Show that if XY ~ B, (r, s), then we 
must have s=b+q and rzaor r- p. 


12. Let Х|, X», ..., X, be i.i.d. В, (a, 1) variates. Show that max (X,, X5, ..., X,) ~ By (na, 1) 


13. If (X, Y) has density f(x, у) = x^^ (у = гё? /Г(а) F(b), О<х<у<‹со, show that W=X/Y 
has B, distribution. 
14. Show that if X ~ B, (n, m) and G is the prs mean, then 


1 
В(т, п) дп 


LAPLACE (OR DOUBLE EXPONENTIAL) DISTRIBUTION 


Жа п)=—— 2 [in Г(п) – п Г(т + л) ). 


С = 


19-40. Definition 
A continuous variates Х is said to possess double exponential (or Laplace) distribution, 
if its p.d.f. is given by 


Дх) = tre мм, -e«x«o, À»0,pn«o. "iy 
Its special case u = 0 is most frequented ; a variate X with 

Ax 14477) 20, —o«x«o M rv. 
is denoted by Lap (A) : If X follows law (1), it may be denoted by Lap (и, A). 
19-41. М.С.Е, Cumulants and Absolute Moments 


МОХ) 3 9D QE кт); SMG X) =e 3270? + Р) [§ 8-16 (15)] 
K(t:X) = hi ates wap 
> © аз rem or кзы 
2r 
It follows that ki = H, ky, = 2" i kop a =0 Wi 
Thus „= u-2/X, К, 212/X, р, =k, 20, py =k, +3А2 =24/) 


2 
H3 _ m "ТЯ 

| dier vhs at m a a 

Since Yı = 0, the distribution is symmetric (not skewed) and y; > O implies that distribution 


is Leptocurtic. Observe that the point (B,, B,) lies on the straight line p, — В, =6. 
= ЕХ) = f^, ети x-y di- 3M, e ^ (ly dy (y sIx- pl) 


AD +I) £t 


v= Af e? y'dy= =—, 
ч y 14 ay" af 


[Even-integrand property] 


Р, 8? | | Laplace Distribution — 


19-42. Inter-quartile Range 
The Lap (p, A)-distribution is symmetric about X = p; hence p must be the median. 


Let Q, and Q, be the lower and upper quartiles; then by definition 


i " f z^ Mena dy m Ms nua dw Лу х-н) 
“3° М? e? йу=[е'©”-1 [7 0,-ин<0] 
Q-w = і > Ми-0,)=п2 (1) 
Similarly, МО, - р) = (n2. zy 


Adding (i) and (ii) we get 4(0,-Q,)=2n2 = Q,-Q, = Q/2)0n2. 


19-43. A Worked-out Problem 
Example : If X,, | <k <4 are iid N(0, 1) r.v.s., show that Y = X, X, - X, X, has p.d f. 


fo) = Lg, —-o«yc«oo. 


Solution. Recall that if X, ~ N(0, 1) and X ~ gam (А, a) then 


àt:X) = e; ма: Х)= 1-0“ NT 

$G:Y) = o(t: X, X, - X4 X,)206 (t: X, X;).60 (71: X, X4) [by indep.] 
DUX, X) = Ec) - EE (е 1X, = x, -Eqe 1€) [Double-E Rule] 
= E[e"*] 2 (1 2)? [> X -1 X? is gam (4, 1) Exp.19-3] 


Thus “у = 042y'2.0-2)'? 21/00) = Y-Lap (1,0). 
Problems with Solutions Provided at the End of the Text 
1*. If X is Lap (0, 4) and Y = a + bX + cX’, find Corr (X, Y). 
2*. For a random variable X with p.d.f. 
f(x, 9) = [2r (1+ 0)]' 2 exp (-X1x1'9), 820, A>0, —oo « x « oo, obtain p, (central 
moments) and hence show that B, = T(50) F'(0)/[T (30). 


Exercise 19(c) 
1. А r.v. has Lap (и, А) distribution. If c is any pos. number less than т, show thal 
E(X - cl) = i^! [е0 + Ау — c)]. 


2. Let X and Y be two i.i.d. variates with p.d.f. f(x) = Le^!*', -œ< x «oo. 


(a) Find the distribution of X + Y. 
(b) Find the joint characteristic function of X + Y and X - Y. 
Deduce : Var (X + YI X - Y) 2 2 + (x у)? (x - у  3/3(x - y + 1). 
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Bá 
з. Let X and Y be i.i.d. variates with p.d.f, f(x) = 4 exp (-l x ~ и!) OCALA 
Find the Ch. Function of = (1 -p)X + ру, 0 < р < 1/2 


4. Calculate the semi-interquartile range for Lap (p, А) distribution 
CAUCHY DISTRIBUTION 


19-50. Definition 
A random variable X having the p.d.f. 


fix) = bizib’ + (х — ay], -wex«co, Б> 0. (1) 


is said to be Cauchy distributed with location parameter а and spread parameter Ь > О. 


A variate with density (1) is written X ~ Chy (a, b). The case a = 0, b = 1, occurs 
frequently 
Дх) = 1/х (1 + x?), — o0 « X o0 vl) 


and we write X ~ Chy (0, 1) for this standard density. 
Cumulative Distribution Function 


mee" >. b dt тег T = 
FQ). = Ei SE EP ok, BB "we 


f(x) 


0 1 2 


-2 -1 
CAUCHY DISTRIBUTION 


19-51. Slow Convergence to Zero 
The general shape of Cauchy distribution is similar to Normal curve, but it decreases 


more slowly for large values of x. To be specific, using c.d.f. we observe that 
(1) P(IX-al«b)-» F(a* b)- F(a- b) - (m^ tan! 1) - [E 7 tan (-D] = $. 
(ii) P(I X —al< 2b) = F(a + 2b) - F(a- 2b -2n^ tan”! (2) = 0.706. 


(ii) P(1 X -al< 3b} = F(a + 3b) - F(a 3b) = 21^" tan (3) = 0.795. 
For Мр, o^), the corresponding values, on the analogy in some sense that b ~ с, are 
P(IX -al« o) 06826, P(IX —al«26) = 09544, P(IX -al< 3с} = 09974. 


The higher values for N(y, o?) indicate a larger concentration of area close to p than 
for Cauchy a with implications as to their rate of slow fall off. Figure indicates this 


situation, 
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19-52. Non-existence of Moment Generating Function 
The m.g.f. of Cauchy distribution does not exist for / # 0. To see this, consider (take q ( 


b m e bt; € 
— ———7 dx 2 — |, —— dx 
M(t: X) = n f о p? } x С л Ío р? Ex? 


Since e" +1+tx+O(t), where О(г) > 0 for t > 0, the above gives 


е b(l + tx) 
0 n(b? +x’) 
It follows that no m.g.f. for Cauchy variate exists. 


dx —> ©. 


M(t: X) > 


19-53. Mode and Points of Inflexion. Median 


Let y=b/n(b’ +2’), z=x-a, -o«x«o. 
Take logarithm of both sides and then differentiate twice 

у'/у=—24/(Ь? + 22), (у''/у)- (у' /у)? 2-20? - 27) Kb’ + zy, (у' = ау/а). — ...(1) 
Now y' 20 => z=0 and y" < Oat z = 0. Thus z = 0, i.e. x = a gives the Modal Value, 
i.e. Chy (a, b) has a maximum at x = a. 
Now put y" = 0 and eliminate y' between (11) and (111); this gives За =b > х=а+ 
(b/43) = a x 0.577b. These are the two points of оп of Chy (a, b) and may be 
compared with the two points of inflection of N(p, o ?) xm аге р + с. 
Note. The max. of f(x) corresponds to the min. of [fG)] ! = g(x) say. Now g(x) = ЦЕ 
+(х-а) a g (x) = 2k(x — a), g"(x) = 2k. Thus g'(x) = 0 => x =a and g"(a) > 0. So g(x) is 
min. at x = a, i.e. f(x) is max. at x = a. Hence x = a, is the Modal value of Cauchy-variate. 
Median. Using the c.d.f., if m is the median of Chy (a, b), then 


1Е(т) = ltn” tan! [(m — a)/ b] > m=a. 


19-54. Characteristic Function: (t: Х) = ен"! [89-70] 

Reproductive Property. If X, ~ Chy (a,, bj) and X, ~ Chy (а,, b,) are independent, then 
(X, + X,) ~ Chy (a, + a, b, + b,). [§9-71] 

The result for 5, = X, + X, +... + X,, follows by Mathematical Induction. 

Distribution of the Mean. If Х|, X,, ..., X, are i.i.d. Chy (a, b)-variates, then 


X =(X, +X, +...+X,)/n~Chy (a,b). [§9-71 Cor] 
Remark. There is no convergence of the arithmetic mean to a constant, not because 
the mean E(X) does not exist, but that $(r: X) implies it. 


19-55. Some Important Theorems Concerning Cauchy Distrihutton 
Theorem 1. Random variable X is Chy (a, b) iff X^! is Chy [a/(a° + b^), bia’ + b Ш 
Proof. Since Х is Chy (a, b), its elemental probability differential is 


dP, (x) = bdx/n[b* +(x – а)?], —-O<X<O, А1) 


d ER ч » 3 
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Now let y = x $ and put y= 1/x, dy = -dx/x*. Then (1 ) reduces to 


АР, (у) - b dy / n[P^ y? "i (1 ау)? ], 00 < y < 9% 


b l dy _ dy 


н ree — PW o 


n(a’ + b^) [у> -2ay/(à +b) +1/(@ +b] m [(y-a'Y «b7]' 


where b' = Ба? + b^), a’ = al(a’ + b^) and -œ < y < o. 
From (2) follows the result Y ~ Chy (a', b'). Now let Y ~ (a', b) ; then X = y a Chy (4", b"), 
where a" = a'/(a? +b”) =a; b" = Ьа? + Ь?) = b. 
Thus X ~ Chy (a ; b) = X' ~ Chy [a/(à? + b^), bila? + bò). 
Remark. This theorem does not characterize the Cauchy distribution. 
That is, if X and X^! have the same p.d.f. ; X need not be Chy (0, 1), 
Let f(x) = 101 +x)’, x 2 0, f(x) = 0, otherwise. 
Then Y = X^, has p.d.f. g(y) = 1/(1 + у), y > 0, g(y) = 0, otherwise. 
Theorem 2. If X ~ МОО, o?) and Y - N(0, o?) are independent variates, then U — X/Y is 
standard Cauchy distributed : 
Ди) = In(1 +u), -0 < u < о. 
The converse to this theorem is not true. 
Proof. Since X and Y are indep. N (0, o^) variates, their joint elemental p.d.f. is 


dP(x, y) = f, (x) ах. f, (y) dy = xo?) ! exp [-(x? + y")/2o?]dxdy, — < x, y < œ. 


Let u = х/у, у = y So that х= иу, у = у. 


Das TEN Ox/Ou дх/ду 
O(uv) |Әу/ди Oy[8v 


So dx dy = | v du dv. The elemental p.d.f. of U and V is thus 


у и 
Os Jl 


dP(u, v) = (2пс>)`! exp [-(1+w’)v? / 20?]l vIdudv, — о <u, v «oo 


The marginal p.d.f. of U, obtained by summing out v is 


dF(u) = L f? expl-( +) v! 126?]I vl dv = D [^ exp [-(14- v? 207] v dv 
210 "o 
2 
waar [etj 
n(l +u?) 3 n(l-- u^) 2с 
Thus flu) = 1/n(1+u’), — 0 <и « oo. 


Converse. We establish : If X and Y are i.i.d. variates then (X/Y) is standard Cauchy, 
but X and Y need not be normally distributed. 


Proof. Let Ло) = (Q2/m) (1+ х)", 1х1< о, then the joint elemental p.d.f. of i.i.d. 
Variates is 
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2 dx dy 
dP(x, у) = =, : mH) “COCK, ne 
х“ (14x )(1+у]) 
Under the transformations, и = x/y, v = y; dx dy = | v | du dv, the elemental p.d.f. becom, 
2 Ividudv l 
dP(u, v) = — —— r 0 <и, V «0o 


п (1+ у“) (1 cu 
The marginal p.d.f. of U is thus 
2 du Г КШ _ 4du ,« y dv | I | 
9 Ы 1 


ай 


i j- ae "ME" 2 
ee ia wy): wx sevo +’) 


dF(u) = 


2w^ du ,« dz Qu* darse | l a . ТР 
= Í JISSLDIER, 1. I | — az, [v^ = z] 


OO ae Өй ” ?) 2 
к^ "abest zy л (1—7) ow 142 


2w du | Bes, ( 3 2 ^ w du du 
= ——————1—tan |-—|-tan z} -———-————-. 
n (1-w?) lw w o n(l+w) m(l-w^) 
Thus, U = X/Y is Chy (0, 1), but X and Y are not N(0, 1) variates. 


Note. $20-72 contains proof for Correlated r.v.'s. 


Cor. Folded Cauchy Distribution : 
If Z = X/Y, then | Z| = | X/Y | is called folded Cauchy variate. Now p.d.f. of Z is 


F(z) =1/n(1 2°), —~O<z7<0 


If g(z) is the p.d.f. of | Z I, then g(z) = fíz) + K-z), z>0; hence 
g(z) = 2/n(1 + z), z> 0. [Folded-Cauchy density] 


Theorem 3. If X ~ N(0, o7), and Y ~ №0, o2) are independent variates, then (X/Y) and 
X/| Y | have the same standard Cauchy distribution [Example 16-27]. 


19-56. Worked-out Problems 

Example 1. A needle spins about the point (0, b) of 
the x-y plane, with b > 0 and comes to stop thereby 
determining an angle 0. The direction of the needle 
then intersects OX at a point (X, 0). Assuming Ө is 
uniformly distributed over (—1/2, 7/2), find the p.d.f. 
of the r.v. X. 

Solution. We are given f(0) = 1/n,10 | < 1/2; f(0) = 0, 
101> n2. 

The r.v. X is given by X = b to tan 0. Thus 


Fy(x) = P(X < x) = P(btan0 < x) = P (0 < tan ' (x / b)) [0, = tan"! (x/b)] 


> 


Differentiating: f(x) = [i.e. X ~ Chy (0, d)] 


1 
[SCR 
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Example 2. If X denotes the tangent of an angle ө Каинды in m Mone at 
random from (—n/2, 1/2), then X is Cauchy distributed. 


Solution. Here dP,(0) = d0/n, -n/2 < Ө < n/2. ро TES 

dx = sec Ө dð = (1 + x^) d9, so that 40 = ахі + x 

Further, –7/2 < 0 < л/2 => —o < x < o ; hence ^. probability differential for X is 
dP(x) = dx/x(1 + x’), —o « x « m. 

Remark. The same result shall be obtained if Ө is U(0, л) or 0 is U(0, 27). 


Example 3. The random variables X and Y are indep. X is Pois (m) and Y is Chy(0, a). 
Show that the characteristic function of XY is exp (m(e ^''' — 1)}. 


tan ©, so put x = tan ©, 


Solution. Recall: M(t: X) = е" -9 g@:Y)=e“! iu 1) 
Qr : XY) 


Ele") as ESE te [n x)) ЗЕ Eo 7" 
exp [m(e ^"' — 1)}, [by 1(5)] 


Exercise 19(d) 


I 


1. Discuss : Cauchy distribution is often quoted as a distribution providing counter examples. 
2. (i) I£ X ~ Chy (0, 1), find P(X? « c). 
(ii) X ~ Chy (0, 1), find the values a and b such that 


Р{1ХІ<а} = 5, P{IX1< b} = 0.6828. 


3. Let X ~ Chy (0, 1). Find the p.d.f. of (i) Y=a+ bX, b #0 
Gi) U=1 E , Gii W=1/X, (iv) Z= x identify the distribution. 

4. If X, X, X4, X, are independent N(0, 1) variates, find the distribution of 
(а) (X,/X,) + (ХХА). (b) (XI X, D) + (ХХ, I). 

S std, Xs «X, be independent variates with X, ~ Chy (ц, Aj), i = 1, 2, ..., n. Show that 
X2 [X(U/X)] | ~ Chy (и', А”) where 


"c Hu que PC A= Y Ni p= pi u 
3 gl FAM. poet cous ЕТТ, Bau 


6. If X, 1 <i<narei.id. Chy (0, 1) variates, find the F of Y= 12a X; + b)] ! where a; + 0 and 
b, are real numbers. 

T. If X be Chy (0. 1) show that for every —o < y < z < oo, E(2X | y < X <z) = alb, where a= [(1 +x y 
(1 5], b= tan! [(z - у)/(1 + 2у)]. 

8. Let X and Y be i.i.d. Chy (0, a) variates. Prove that U = XY has the density {a т 4? - a^)) 
т (и2/4“), -œ < u < oo. 
Show further that, if a = 1, the p.d.f. of X/Y is identical with the p.d.f. of XY and explain why 
it is so. 

9. If X,Y, Z are i.i.d. Chy (0, a) variates, find the p.d.f. of XYZ. 

10. IfX is Chy (0, 1), find E{min (TXT, 19). 


588 More Continuous Distributions — 
= II 0 — 


11. X isthe mean of n independent variates distributed like X, and X has a symmetric distributio, 
Ў NS 


Y teteihuti é ve that the characteri 
If X, has exactly the same distribution as X for all тре C E cteristic functio, 
of X is ft) = е Itl for some real constant c. Identify X and generalize the above result 
x H i d { » ^^f p » . Y 
12. Let X,, X,, ... be a sequence of independent variates. If n is perfect square, then X, is Chy (0, 4) 


2 , 
| ; iance с“. Discuss the asym sh; 
otherwise X, has ac.d.f. F(x), with mean zero and variance с”. Disc ymptotic behaviour 


of S, / n. 
19-60. Miscellaneous Worked-out Problems | 
Example 1. If X is a Weibull variate, find its mean ча уапапсе. 
Solution. Here f (x) = (k/a) [(x - uya] | exp {-[(x- ua] }, x> p, a> Кә mm 


к-1 T 
E(X - р)" = ai. Ex (х= p) exp E Jas 


a a 
r [9 k+r-1 k ES. 

= МУ exp (-y ) dy | 5 y! 

= d Fedd Tr =y 0 


Put r = 1, 2, in EX- y) = a’  T[1 + (r/k)] to obtain : 
E(X- р) = аГ(1 + 10) > E(X) =p tal (1 + 1/k). 
Е(Х- p)? = а? Г(1 + 2/0) > EQ) = 2p[p + аГ(1 + 1/0] — p? + а?Г(1 + 2/0. 
А. Var (X) = Е(Х?) - E(X) = a? {Г(1 + 2/0) – Г(1 + 1/0)]2). 
Note. For the standard Weibull distribution (и = 0, а = 1), р = T'[(r/k) + 1] 
Thus E(X) = Г(1 +k"); Var (X) = Г(1 + 2k") - [T(1 + kJ’, etc. 


Comments. For Weibull distribution f(x) = ag x^^! e", x>0 


etes) tenti) 
Example 2. Find the m.g.f. and moments of Gumbel (or extreme value) distribution. 


Solution. Gumbel distribution : F(x) = exp [е^ s uA A>0, lal«o, -о<х<®. 
Let z- e ^*^, so that f(x) = F'(x) =Aze™, dx - – (4:1 А). -w<z<0, 


k 
E(X - a) = |? (x - a fic) ds (rn) e de=(-1/A)' е On z ede 0 


Now Г(п) = |? e" t"^! dt, Y'(n) = [ре t" n tdt, ..., r0 (n) = [^ e^ r"^' (dn г)‘ di 
0 


Thus r (1) = [Pe (inr) at „(2 
| Е(Х-а)* = (-1/)'. T (1). No 
The psi function (digamma function) is defined by у(х) = аГ(х)/ах : and its nth derivative is 
yore ntt v Les pity aiti EL. 
Arp T we (D- 06-1016 )* ТЕП 
Thus E(X - ay = (К-П)! А)“ Y ee. NC 
r=0 (1 + ry j 
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[wi] 


$ ' ы = i 1 
Recall : -Г'(1) = с = lim E + 2 + 3 T usd m -tnn S057216. [Euler's constant] 


So H=E(X) =a -T (IXA = а + (cid) [by (2)] 


Var X = E(X - a)’ - (p - a = (1/32) (£1/ n) - (c/ AY. =[(т° / 6) — c]/ №. 


о 


M(t: X) = E(e™) = ех f(x) dx =e" ex г" dz=e"T ( — г) [eJ 


1*. 


2*. 


э". 


д". 


Se, 


À 


Problems with Solutions Provided at the End of the Text 
The r.v. X has Weibull law : f(x) = (6x)! exp[-4x/3], x 0 and r.v. Y has the 


Weibull law : g(y)= (4A yy exp C4» 12), у>0. 
Find the density of Z = X/Y and hence show that P(X < Y) = 2/5. 
Let Х|, X,, ..., X, be a random sample from Weibull distribution 


k-1 k 
О) = ee) exp|-(2=#) | x>p, (a>0, К> 0). (1) 


Find the distribution of Y = min (X,, X,, ..., X,} and identify it. 
cop Wc» eT i.i.d. expo (A) variates. Let 

Y=X,+4X,+...+(1/mX,; 2 = max (X, Х,,...‚ X,]. 
Prove that Y and Z have the same distribution. 
A family of distributions is defined by 

(айах) = xfi(b + b,x? + b,x" ) a) 
and the frequency function vanishes at the terminals of its range. Show that the 
central moments are given by 

by(2n + 1) Ы, + PE + 3) р,, + b(OQn + 5) o, у= =н 2: 
Show that for a Pearson distribution df/f = (a + x) dx/(by + b,x + b,x? ) the 
characteristic function $ obeys the relation 
b,09'' + (1+ 2b, + b,8) o' + (at b, + ,0)ф = 0 
where Ө = it, ф' = df/d0, etc. Deduce the recurrence relation for moments. 
Show also that the cumulants generating function y obeys the relation 
b,O(y" + у?) + (1 + 2b, + b,0)y' + (a + b, + 0) = 0 

Hence show that the cumulants obey the recurrence relation 


(^ ane (75 аа. jt E Ж А +01+(0+ 25k. = 
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10. 


11. 


12. 


13. 


. Let f(x, у) = 


Assorted Problems 


. Six independent observations are to be made on a r.v. with density f(x) = 2х, 0) < x< LT 
* ing 


interval (0, 1) is divided into four class intervals of equal length. What is the probability that 
exactly three observations fall in the left-most class interval, two in the next, one in the 
further next and none in the right-most class interval ? 1 
If X ~ U(0, 1) and Y ~ f, are independent, find the density of Z= X- Y, where Ќу) = 2y,0 < у | 
Evaluate P(Y» X). — 
If X ~ B,(a, b) and Y ~ gam (1, a + b) are independent, show that XY and (1 — X)Y are independen 
Let X ~ U(0, 1). Find a transformation и = u(x) such that 
(0 Y-u(X)is gam (1/2, 1/2) (ii) Y 2 &(X) is Ву(2, 1). 
Let X ~ B,(2, 2). Find a transformation u = u(x) such that Y = u(X) has the p.d.f. 

FOL 12y° (1 id) 0<у< 1; Ду) = 0, elsewhere. 
The daily output of a perishable commodity is described by gam (1, 4) variate, and the 
proportion of this output which perishes before reaching the market is described by an 
independent B,(2, 2) variate. Show that the probability that a day's production will result in 
the loss of at most 3 units and atleast 2 units reaching the market is 3(e° - 4)/е?. 


. Variate X has the p.d.f. (called arc-sine density) f(x) = 1/ ny 1 Ber see 1, 


Show that : (a) X? and Id + X) are identically distributed (i.d.). (b) X? and | – X? are i.d., 
(c) X and 2X (1 – ү? are identically distributed. 


. Let X and Y be i.i.d. Дх) = {ny (4/62) - x? | !,1х1<12/Ь1. Show that (X + Y)/b and XY are 


identically distributed. 
Conversely, let X and Y be two i.i.d. variates such that : 
(i) (X + Y)/b and XY are identically distributed. 
(ii) The common c.d.f. of X and Y, is symmetric about origin and is uniquely determined by 
the moments. Show that X and Y follow the above law. 
Ta y'a -xy 
Morera arho 0 у 1. 
[Dirichlet's distribution with parameters a, b, с and written Dirch (a, b, c)] 
(i) Show that if (X, Y) is Dirich (a, b, c) then X and Y/(1 — X) are independent and find their 
respective distributions. 
(ii) Show that if (X, Y) is Dirich (a, a + 1, a), then E[(X – Xy] = 2a/(3a + 1). | 
If X, ~ gam (a,), i= 1, 2, 3 are independent variates, show that X,/(X, + X, + Y,) and XX, + А 
+ X4) follow a bivariate Dirichlet distribution. 7 
A random vector (X, Y) has Dirich (a, b, c) distribution. Show that X is B,(a, b + c) апд} 
B,(b, a + c), prove that p(X, Y) < 0 and explain why it is so. 
If X is gam (p), Y is B(p,p- q) then /2xy is №0, 1) if q = H . However, if 4 7 p - 47 ': then 
XY is Expo (1). - 
For the Pearsonian family of distributions specified by f '/f ^ (x + a)l(by + bx + b,x’) show! 
Mean - Mode _ VB; (B. + 3) 
S.D. ~ (5p, = 6B, — 9)’ 


It is better to live rich than to die rich. (Samuel Johnson) 
ыд ооо ыо ооо ырдо ыыы ыыы ут УКУ К ee 


Everyone has a photographic memory. Some don’t have film. 


Appendix: 


Compound Distributions 


F-1. Definition 


Let F(x, LIP Ө; ы өр be a given distribution function. If any of its parameters is 
ascribed a distribution (the compounding distribution), then the unconditional 
distribution of F(x, Ө,, 0,, ..., Ө, is called a compound distribution. 


F-2. Compound Poisson Distribution 


A variate X is Pois (M) where the parameter M itself is gam (A, r) with r an integer ; to 
find the unconditional distribution of X. Here, 


P(X -kIM-2m)se"m'/k!;m20,k20,12,..; fim = Xe "т /IT(r), m2 0. 
The Multi-Stage (Break-down) Rule for continuous variates is 

P{X =k) = E,P(m;) P(X = kVIm;) = |? f(m) P(X = КІМ = т) dm 
e" m* m^! e" X 


се Qaa E Coo PR toe UO Pm, «Ч © r*k-l,-(I* A)m 
fT Ste =^ pr" е am 


Ox Feb. teek- АЛТ E iye 
= KIT Аут KM —DE X) 4a к- А 


where p = A/(1 + A). Thus, the unconditional distribution of X is Neg-bin (r, p). 


Р(Х =k) = | 


Е-3. Compound Binomial Distribution 
A variate X is bin (N, p) where the parameter N itself is Pois (A); to find the unconditional 


distribution of X. Here 
P(X = хіп) = (п) атр", x=0, 12,2; (п) = е^" /п!п= 0,1 
The Multi-Stage (Break-down) Rule : Р(Х = х) = E, P(n) Р(Х = x | n) yields 
L2 go» n!p* en €^ Op) $ р ы 


Р(Х=х) = D n! x!(n-x)! x! (n = х)! 


= £ "Op". ем СТО Le012..e. 
x} i 
Thus, the unconditional distribution of X is Pois (Ap). 


F4. Hyp-geom and Bin Combination Theorem ut 
If Y is bin (N, p) and (X ! y) is H-G (N, у, n), у = 0, 1, 2, ..., М, then prove that. X is 
bin (n, p) and (Y | x) is x + bin (N — n, p); i. 


» =x М-м (у= 4) 
РҮ =yiX=x) = (т) pnta nmt 


, 
p P 
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Proof. PX =x1Y=y)= C): y (3) (H-G-pmf) 
y\(N=-y 
PX mx, Yay) = Ma) e "9. D Tv bin (N, p)] 
РР 
(А) (№ y x) NO? n! күне . n N=-n\ ‚у 
E een АННИ 


Since x Sy and x > n + у – N, so range of yisx<y<N-n+x. 
To find the marginal density of X, we sum out y. Putting y = x + z, we get 
М№-п+ N- " = x n-x Бл. N- Ра -H-z 
рез = C) È і те ш ре 


ух 


(") р" a" (q+ py" =(")q"* p". 


proton MBN quee e 


UAI Medii ae 


Mo 


Note. 


F-5. Normal-Normal Combination Theorem 
If Y ~ N(X, w) and X ~ N(m, v), show that Y ~ N(m, v + w) and 
or» y (tm no) 


PW. pst wey 


Proof. M(t : Y) = Е(е") = Е; (б уе” | Х) = Е ti) 2i e! "E(e*) 
= 2" exp (mt + 10у) = exp [mt + (у + w)]. 


Thus, Y is Normal with stated parameters. We now use Baye’s Reversal Rule : 


fly = OID A _ ер[-20- х) /0] EEUU Paws) 
Љу V2nw exp[-1( -mY/(vew) Улу 


bes Woa (к-т)? (-my "T А 
a" gel | w OO RIE |) (c (wy 


2 2,2 #2 2 
P exo _ 2x(vy+wm) | y у + мт 2ту Al 


2| 52 vw wv(w + v) wtvig 
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1 l| 2 2х(уу+ wm) y wm \ / | 
су27 2 w+y Wy | 


J M 
1 1 уу + ит i 5 
= ех ——|х—— " 
су27 1 ak Wy | б | 


Е-6. Worked-out Problems 


Example 1. Find the unconditional distribution of X in the following cases : 


(a) X ~ bin (N, p) and N ~ bin (m, p^). (b) X ~ bin (n, p) and p ~ Ва, Р) 
(c) X ~ Pois (M) and M ~ gam (a, А). (d) X ~ NB (л, p) and p ~ B,(a, 5) 
(e) X ~ NB(n, p) and N ~ gem (p^). (f) X ~ Expo (Y) and Y ~ Unif(0, 1). 


(g) X ~ №0, 1/0) and 6 ~ gam (in, +n) (h) X - Bur (4;a, b) and a ~ gam (с, A) 


(1) X ~ gam (im, 0) and 0 ~ gam (in, A), (A = n/ m). 
In each case, name the distribution if possible. 
Solution. We can proceed as in $E-2 or use Generating functions. 


(a) G(t : X) = E) - E, {E(r* IN =n)} - E(q pt)” =E)" =(q' + p'r')" 
= [q' + p'(q + pt)" = [1— pp’ + pp't]". Thus X ~ bin (m, pp’). 


- а- 1 1-72) 'dz 
(b) P(X = D= LPUX=kip=2) f, (d= (т) а-ә — à 


k*a-1 n-k*b-1 
т nz (1—2) _(n\ Bk +an—k+b) ‚_ wi S ce 
E (") ea VUL Y ,k-0,1,..,n (Beta-bin distribution) 
(c) G(t: X) = Er -E,(E( 1M = m)) = Ee" ^ ^] (m.g.f. of M) 
i n uar pee _ 
À 1+1 1+ А (1 — qt)“ 
Thus X ~ NB(a, p), where p = A/(1+A). [gamma mixture of Poissons] 
J _p(ktn—-1) 2 zr 0-2", 
(d) PIX =k} = РХ kl pe 2f, Od f; ( ИАА ): (1- 2) a aiian 


k+n-1 1 l а+п-1гү _ P k-I 
- (т) вара 
n+k—1)Baatn,b+k) ,_ 
= ( n-1 ) EN a ELI. 
For the special case, X ~ gem (p), using n = 1, k — k — 1, we get 


P(X =k) = Ba*lbrk-D aDbek-D.TI(asb) , 


-z—L——————,k21423... 
B(a, b) T (a * b + К) ГО) ha 
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N 
(e) Git: X) =E(t*) = E, (Ee i-e; = E(t')" 


= = ВР = РЕ ce . Thus X ~ geom [pp’/(1 — pq')] 
1-4" l-qt-pq' l-pq'N 1-pq 
| 
Eu à E | 
(0 Јо) = [ ре? 19) 06) , (Integ. by Parts) 
y 0 
ak [^ detl | 
"v Cs e. vigi 
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102 Ре „а 
0 е 70А е (1/2)n0 g (1/2)n (in 


n/2 
) dO 


Өну 5: Хз M (in) Г[(л + 1) / 2] 
n+x” gl* /21- | qo = 2 ) =, -0< o0 
= Jen T(n/2) ^ h J2xT(n/2) [1n х?)]"" ^ Е 
2 —(n+1)/2 
203 jd eod «oe too, 
вл) п 
This is the p.d.f. of Student-Fisher ż statistic. 
(h) X ~ Bur (A, a, b) means f, (x) - ab КЕ, TOL ux Y n dar оо, 
a ,b-1 с -ìa .c-1 
fo) = f'f(xla) g(a)da = b RI EE „ | | 
0 (A. + x^) Г(с) | 
br x b-1 Qe ^ yat куа Xie" - | 
== аа Р t = i 
бухг? Ger y (A+ x?) D a 
€ b-1 c „b-i 
(oU perra er Teo — 
x )I(co) (ЕЮ) 
ber’ x^^! 1 | 
(x^) fn (A 4 x) - X -Un АЈ"! | 
1 Р Ө"? e? yo e"? 01/2)" - 15 Q/2)n 
(i) fo) = ff f(x10) 800) dd = f; ты NBN | 
- Ry ueri M -(.«)0gim «2-149 = Г(1т+ in) E V ma yet J х<9% 
T(m/2)T(n/2) ГО т) Гл) (Аж х)" 
(m / ny"? xyU2-1 


= =., 0K <r, 
Вт, $n) [1+ (mx n)]"* ^? 


This is p.d.f. of Fisher F-statistic. 


$F-6. Worked-out Problems L-. 9 D 


Example 2. The conditional probability that the variate X should lie within the range 
dx for a given с is given by 


(c42n)" exp (-d(x - u)? /o?) dx, -0 < x «o 
while the probability of c itself lying within the range do is 
o exp (-o? /2с;}с do, 0«6 « o. [o, = const.] 
Show that the unconditional (i.e. marginal) distribution of X has the p.d.f. 
Qo,)' exp(-I1x- ц Voy}, -0 < x < o. 
Solution. We are given that f(x | c) is Мр, с?) and Ќо) = (с/с) ехр {-07/265}, 0«o0«o 
E(e* ) - E(E(e* [0)} - Eg" **9" b. teu ud М o?) Double-E Rule 
2 2. чу Ht % ВЈ 
= e"E (e? Wy = elt бше" е] о" 2 da = Dead - 9202 do , [2 н 1/02] 
99 60 
EX S ai 
О 0?- 
Vem 
А – 1? 
This is the m.g.f. of Lap (A, и) distribution. Hence the reqd. p.d.f. is given by 


Tere e dz, уа gare- 1 


fx) jM = ee —o«x«o. 
0 


Example 3. Let X ~ U(0, 1) and (Y | X = x) ~ bin (n, x), i.e. 
P{Y 2ylX2x]2 "C, x* (0- х)", у=0,1,...,п 
Find the distribution of Y. What is E(Y) ? | 
Solution. E(Y) = E,[E,(YI X)] = Ey(nX) = nE(X) = nd) = 1n. 
р = PY = у}= [PW =у\Х = х). fX) dx [Multi-Stage Rule] 
=b) x'ü- xy? id= MI (y*D- r- x)" Jara. 
D(y* DI (n— EIU 4 n!y'(n— y)! 
= ()}Ву+Ьп-у+1)= () D(n*2) |... (n-ylyl(n« 1)! 
= l/(n + 1). 
Thus, P(Y = y] = In + 1), 0 € y Xn ie. Y~ 00, 1, 2, ..., n). This also gives E(Y) = 4 


Example 4. The distribution of X given 0 is Unif(0, 0). The prior distribution of 0 has 
P-d.f. (0) = 0/02, Ө > k. Find the posterior distribution of Ө. 

Solution. Here fix | Ө) = 1/0, Os x € 0 and g(0) = ko, 0»k 

r fix, Ө) = fix10) (0) = 0/0, 0О<х<Ө, O>k 
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The де density f(x) depends on whether x < k or x>k. Thus ; 


k 
© К l 
If x < k < 0, then f,(x) = J, f(x, 0) d0 = Fal ЙЕ: 


If k « x « 6, then / (х) = A AT. k«x«0«o. 


There is knock-on effect on the form of f(0 | x). Thus 


k/0° 2E ШӨ" ^ (2x 
Өх) = ——- f 6; Өх) =—— = sE 

SUA Pet ermet ЛАА наа в" 

Example 5. Let X be bin (n, 1/2) and let the compounding distribution of the parameter 


n be fn) = n/3, n = 1, 2. Find the unconditional distribution of X and its variance. 


Solution. Given : f(x | n) = (") (9)10—9082,. ри; POV=n)= tn, n = 1, 2, 


P(X =x, N=n)=P(X=x1N=n)P(N=n)=4("\(4)', x 0,52, n 2 = 1,2 
By the Theorem of Total Probability : P(X = х) = У, Р(Х =x, N = п) 

Р(Х = 0) = Р(Х = 0, N= 1) + Р(Х = 0, №= 2) = (1) + (2) = 1 

Р(Х = 1) = Р(Х = 1, М№= 1) + Р(Х = 1, М= 2) = (1) + (1) = 1 

Р(Х = 2) = Р(Х = 2, М = 2) = + (n 2 х) 
Thus the unconditional distribution of X is 

P(X =0) = i, P(X=1)=4, Р(Х=2)= { 


E(X) = Ex Р(Х= х)=1+2.1= 5; EX?) = EE P(X = x) -1.144.1-1 


Var (X) = (D-GD- G2 
^ xample 6. If X | Y = y is gam (a, Y) and Y is gam (b, 1), show that the unconditional 
v istribution of X is B,,(a, b). Further, if ZI (X = x, Y = y) is bin (n, x/(1 + x)), find the un- 
- onditional distribution of Z and its variance. 
Solution. (i) From X | y ~ gam (a, y) we instantly get f(x | y) = e?" x^^ ! y"/T(a). 


a- le yx b-1.,-y Eu а- і 


р у“ g MN. E e x mU 
fx, y) = f(x I) 0) e V0 |G DIM... 


'^ iind the distribution of X, we integrate out y from (i); thus 


x^^! 


T(a) (b) ^? 

йр ж. hat) UMEN 
P(a)T(b) (1+ x)" ^  B(a,b) (1+ x)**" 

‘his shows that the unconditional distribution of X is Bg(a, b). 


ру a*b-1 e 0 * »dy, x20 


ЛӨ» = 


Ex ercises | — 597 


2 
(ii) Since Z| (X = х, Y= y) is bin (n, X/(1 + x)), we have 


fis» = т) (re) (1) 


gc, % y) = fiz |x, y) Хх, y) — (joint p.m.f.) 
n x? ya th- le y(14 х). a-l 
CERAM ERE | DETTO EN 
(2) (1+ x)" ra) Г(а) Ix deg Cons 


To find out the distribution of Z, we integrate out x and y from above. 


dx dy =(") » (a+b) pier г: 
? F(a)T (b) (1 D^ +x). 


b-1 —v(1+ x) 1*-z- 
: x! r=] 


ко = (Gee >——° 


Г(а)Г(Ъ)(1+ x)" 


= |" 89 xU. dx n| B(a* zn b-z) 
ae x В(а, Б) li (x xy Ot + G+a-2) -(«)}Ж@+ә"с»- э, zs, К Ады: i 


This is unconditioned distribution of Z. Now 


Ez = Wy Y^ Ө B(a- zin b— z) 


— 99 Qe ^*^! ntb-z-1 
Ba, b) (^ Ji^ asl ine 1 £P 


Leiba: 1 b-1 D n—k z-k n-z А = п 
Dy (1-1) а p icu E uA Ba, b) 


= Af 6710-0" 0-0 ade = ht 0-7 0*7! dr AB( a, b) 


Г(к+а)Г(р+а) a" ; 
кисса aie SOP сы ачтан Putting for А 
" T@rk+atb) " (a+b)! | g ] 


n(n — 1) a(a + 1) 
E2-7 rpg) 
Var (Z) = 620) + E(Z) - EXZ) = nab (п + b + а) а + b) (a +b + 1). 


p EZ) = 


Exercises 


1. The distribution of Y is P(Y = n) = (1)", n = 1, 2, 3, ... The conditional distribution of the 


continuous variate X for a discrete variate Y assuming a value n is 
dF = n(1 - x)" ' dx, 0 €x «1. 
Find the marginal distribution of X. 
2. Given f(x I y) = e? y'/x ! and h(y) = е", where Y is continuous y > 0 and X is discrete, i.e. х= 0, 
1, 2, ... Show that the marginal distribution of X is geometric, 
Le. g(x)z(1/2)*. ! Find also the conditional means of X and Y. 
3. Let X be bin (n, p) and let the compounding distribution of the parameter n be bin (m, Р). 
Show that the unconditional distribution of X is bin (m, pp,). 
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4. 


10. 


11. 


Total understanding makes one very indulgent. (Madame De $t 


Let X be bin (n, p) and let the compounding distribution of the parameter p be Pa, b) Shon 
that the unconditional distribution of X ts 

Кх) = Bla + x, b +n - x) [(n + 1) Bla, b) B(x + In-x+1))' x=0, 1,2, T 
Hence find its mean and variance. Find the corresponding quantities if p is U(0, 1) 
Neyman's Contagious Compound distn. Let X be Pois (A, y) w here y itself is an observation of 
a variate Y ~ Pois (m). Find the unconditional distribution of X and show that its mean i les 
than its variance. 
Let X ~ Expo (Y) where Y itself is distributed as gam (r, А). Find the unconditional density of 
X and the conditional density of Y given X = x. i 
Let X be Pois (A) and let the compounding distribution for A possess a Ch. Function $(f). Show 
that the unconditional distribution of X has the Ch. Function $[/(1 – e"^)] and that its mean and 
variance are A and E(A) + Var (A) respectively. 
Let X ~ Expo (Y) and let the compounding distribution of the parameter Y be a discrete variate 


with p.m.f. Р(Ү= 1) = 1/2, P(Y=2)= 4, Р(Ү= 3) = $ 


Find the unconditional distribution of X and its mean and variance. Find also P(X 2 2). Find 
the probability that Y is an odd number and X is atmost 2. 


. Let (X,) be a sequence of i.i.d. LD (Ө) variates [¢n=series distribution with parameter 0]. If 


5= X, * X; +... + Xy where N is Pois (A) show that 5 is distributed as a negative binomial variate 
videt Ain a - 8) i is an integer. 


Let X be U(0, Y) and let the compounding distribution of Y be again U(0, 1). Find the unconditional 
distribution of X. Show that E(Y | x) < 1 and hence deduce that x — 1 2 (п x for 0 < x < 1. If the 
compounding distribution of the parameter Y is Expo (A), find E(X), Var (X), E(Y | x) and E(X y). 


N 
Let (X) be a sequence of Ber (p). Show that È X,) ~ Pois (Ap) when N ~ Pois (A). 


ae!) 


serie ole EIEEE IEEE ИОН НИКИ ЕЕ aa 


Imagination is more powerful than knowledge. (Albert Einstein) 


Bivariate Normal 


Distribution 


20-10. Bivariate Normal Distribution, Marginal and Conditional 
Distributions 


Definition. The r.v.s X and Y are said to possess a Bivariate Normal Distribution with 
five finite parameters pi, jp, су > 0, с, > 0 ; p, if their joint p.d.f. is given by 


f(x, y) = ee A Soe ys Троа. (D 
2no,0, 1-р 


2 ^ y 4 
1 X-H х- ш | У-Н аа e 
h А ИЕ XXL _ ran. 
where Q(x, y) (1—р?) ( o, | 2| С! \ 0, Je о, | | 


Marginal Distributions. It is convenient to write 


EU le dad E КШ aiu P" 
б, 92 ]*'3* 


(ури? t (и pv) 


Then Q(x, y) - u^ + : 


tp 1-p 
2 к E. 2 
Take : Q(x, y) s il 4. (v р) = 93 [H + po; (x = u)/o] 
=p o,yl-Pp 
Q(x, y) = u^ +[(y-=m)/ 05] ...(2) 
where m, = Hy + Po, (x-p,)/o,; o% -oj(1- p^) ...(3) 


From (1) and (2), 


fœ, у) = et - Prides ian 2 
»y Олс Jon o Y 


У f ew > g O7 т) 29 ә 
FOG) = 2 Aan mu ago hm e a 


The integral, being area under N(m,, c?) is unity. 


-u? /2 gn nei 


e 
A x aaau — оо ©. LAS 
fio ля 9, Ул 9, Р те ©) 
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Incidently, УУ у(х, = xf ol 


Thus (1) is a bonafide p.d.f. as it is certainly non-negative. From (5) and hence 
interchange of X, Y, we conclude that 


X ~ Му, с), Y ~ МЖ, 9;). 
Conditional densities : 
From Eq. (4), we readily observe that 
Хх, y) = fio) . fly 1x) 
(YIX 2x) ~ N(m,, o2) 


where m, -E(YIx)- р, +р22(х- p); Var (Y1x) 2 07 =05 (1 - p^. 
1 


Similarly, (X1y) ~ N(m,, 01^), m, =p; +p (y- H5), gr -oj(1- p). 
2 


Note. We write 


K = e ы x = (х,у), H = (Hi H2). 1К1=0102(1—р?), then 
93 Sn 


1 1 = 
fix у) = БОЛГ ТӨК e| 0 <Хх < 00 


This expression сап be readily extended to n variables X,, Х,, ..., X,. 


An alternate modern definition. A random vector (X, Y) is said to possess bivariate 
normal distribution, if for all a and b, Z = aX + bY is a normal variate. 
Remark. The equivalence of two definitions is shown in 820-50. 
It follows that f(x, y) defines a continuous bivariate distribution. The variates X and Y 
with joint p.d.f. f(x, y) given by (2) are said to have a bivariate normal distribution 
with five parameters : цу, ну, Oy, су. When oy = oy = 1 and ну = ру = 0, then X and Y arc 
said to have standard bivariate normal distribution. 
Notation. A bivariate normal distribution with five parameters ру(=р,), ну(= н), 
с=с), с=с) and р is denoted by 

(X, Y) ~ BVN (цу, р, сү, 02; р) 
Remarks. If p = x1, the density function in (2) is 
undefined, indeed the distribution is then called singular, 
with the unit of probability distribution along a st. line 
y = mx + c. In this case, we may argue that X and Y are 
still marginally normal, but linearly related with 
probability 1, that is 

P(Y-y,-*(o)/9o,) (X - p,)} = 1. 
The adjoining figure shows the BVN-surface. 


2 


x 


Bivariate Normal Distribution 


$20-21. Five Parameters I .terpreted 60 1 
20-20. Moment Generating Function —- МЕРЕ. 


Recall : X ~ N(n,, 02), (Y |x) ~ N(m,, с’) 


where т, = Ш +р(6,/с) (x - n), o? = 02 (1- р?). 
We evaluate m.g.f. by Double-E Rule. Note that m, contains x. Now 


M(t, ; t,) E(e^* + nY) di E(E[e^* + HY | X] ) 


li 


Efe" E(e^"1X)), [use m.g.f. of (Y 1x) ~ N (m; 65 )] 


РРР: 
ee за 


exp {Hoty — р(с,/с,)щь + 1072) (pe^ 1/2"), [use m.g.f. of X] 


= exp (t; +10202 — 1р20202 — p(o,/0,) ut; {exp p(t, + (55 /0))t; + 10111 +р(с›/б, yl) 
This instantly provides 


M(t, tj) = exp (If; + Hot» +1 (си + 2poj6;t,t; + 0302)) 


Con Let u- (55) vue Аза Ыш 
О, 6, 0 


Then U ~ №0, 1) апа W ~ №0, 1) are independent. 


E(e" + tW } e Efe” +h (V -pU)NI -p | 


= Efe *"") n = TOPA RNA ARTAN E 
This expectation is the m.g.f. of BVN (0, 0, 1, 1; p). Hence by above 


Proof. M(t,, t;) 


M(t ty) = еМ *2phfa 12) — eit 3262) 
1, i 


2 T 2 
= e" e” [= MUI M, (6) 
Thus, U ~ N(0, I) and W ~ №0, 1) are independent. 
20-21. Five Parameters Interpreted 
Maclaurin's series for the exponential function of the m.g.f. of bivariate normal is 
M(t, t) = 1+ +н + (тиг + 209,9: hf, + 0212] 
+ tipt + pot; + (с + 2po,6:15 + 2 9 Kem 
E(X' ү) =coeff. of (tf tj /r!s!) in M(t, t5) 
E(X)=p,, EY) =p, E(X^) =o; + uj, Ev’) = 0j + p, E(XY) 2 po;0, + шн: 
These instantly provide means and variances [Var X = E(X) - E*(X), etc.] 


Var (X) = o2, Var (Y) 2 02, Соу (X, Y) - p 0,0», Le. Corr (X, Y) - p. 
Thus, all the five parameters stand interpreted. 
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20-30. Regression Function and Regression Curve | | 

If X, Y are jointly distributed and E(Y | x) exists V real x, then r(x) = EQ | x) is called the 
regression function of Y on X. The graph of r(x) is called the regression curve of y оп 
Х. For the BVN distribution 


(Y 1x) ~ Ми, + (0, /6,) (x ^ i). o5 - POT. 
(X1y) - Ми, + p(o,/0,) (у= №), 010 - 921. 
It follows that the regression functions are linear : 
Е(Ү!х)= p, *p(o;/o)x-u); Е(ХІу) =p, + PO) /52) (У - p2). 
Obviously, the regression curves are st. lines. Further, conditional variates are constant. 


The linear regression of X on Y (or Y on X) is homoscedastic (i.e. has equal scattering). 
Comments. All results relating to linear regressions hold true for BVN variates. 


20-40. Level Curves of Normal Correlation Surface 
Here : f(x, y) = Qno,0, 41- p^)! exp (-Q/2), – о «x, y «o. 
with Q - ([G p)/0,} - 2plx - n) (y= u2)/0,9;1* 102 — 3/0; T V - p^. 


BIVARIATE NORMAL DISTRIBUTION 


The surface z = fix, y) is called the Normal correlation surface or bivariate normal 
density surface. Level curves are the contours at fixed elevations of this surface or 4 
the intersection of this surface with planes parallel to the x-y plane. 


The curves along which the p.d.f. is constant are the homothetic ellipses 


(х? /o1) -2p(xy/o,0,) + (7/02) = А2 mU 


[^ (coeff. ху)? — (coeff. x^) (coeff. у?) = 4[(p! — 1/625] < 0] where p, = н; = 0 f^ 


simplicity; with their centres at (0, 0) and major axis inclined at angle Ө with x-axis, given РУ 
tan 2a = 2рсс, /(0; — сі). 


p TEE $20-50. Independence versus Uncorrelatedness 6 03 


For homothetic ellipses, the line of regression of y on x is conjugate to the axis of y. 


1 = а em sa) : ч А 
Тһе line х (parallel to y-axis) intercepts the ellipse (1) into two points whose 
ordinates y,, y, are the roots of the Eq. 


(у /03) - (2ра/с, /с,)у + [(а? /в?)- X] = 0. 
The coordinates of the mid-point of the intersection are x — a, у= i + У) 7 apo;o,. 


Hence, the locus of the mid-point is у= (рс, /с,)х, which is the line of regression of 


Y on X. A similar argument shows that the line of regression of X on Y is conjugate to 
the axis of x. 


Problem. Show that if (X, Y) is BVN (0, 0, сү, 07; 0), the point of inflexion of the 
curve of intersection of the normal correlation surface by planes through the z-axis, 


lie on the elliptic cylinder (х? /с?) + (y? /o2) - 1. 
Solution. The normal correlation surface is 
z= f(x, y) = Qno,0,)'! exp (-[(x?/o2) + (y /o2)]/ 2). 


Any plane through z-axis is y = cx, so that the curve of intersection 15 
= Qn6,0;)! exp[-1(oj + co?) x ]. 


(п 2 = К-1Ах? [А= с? + с2с;2; К =const.] 21.01) 
Points of inflexion are given Бу z” = 0, z" + 0. Hence differentiating (1) 
(z'lz) = -Ax, (z"Iz) = (z'lz) = -A. ...(2) 
Putting z" = 0, and eliminating (z'/z), we get A?! = A. This gives x — T Thus the 
points of inflexion are x = А УТА ДУО. 
For the locus we need eliminate c(= у/х). Thus 
х2 - (0/62) + (c? 762)! = (0/07) + 07/2703)! = o105x (сту + 03x") 
ox? +с2у? = olo) => (х2 /с2) + (o2) 21. (Elliptic Cylinder) 
20-50. Independence versus Uncorrelatedness 
Let (X, Y) be BVN (щщ, Ho ds 0 ; p). Then X and Y are stochastically independent iff p = 0. 
Proof. Recall: M(t,,t,)=exP [pf + Hof» + Loit + 2po,0;t,f, + ETE )]. 
(i) Let X and Y be independent, then Cov (X, Y) 20, ie. р = 0. [which is always true]. 
(ii) Let p = 0, i.e. X and Y are correlated, then 
M(ty,t,)=exp [tpt +0 +10622 + o3] = exp [uut +4011 ]-exp [rS +302 21= Му (1). M, (B). 


This shows that X and Y are independent Normal variates. 
Note. Two uncorrelated variates that have a BVN distribution are always independent. 
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20-51. Theorem. Independence of Sample Mean and Sample Variance 


Let X, 1 <i € n be indep. Mu, с?) variates. Then, X. and 5 = У(Х, – X)'/(n — 1) are 
independent. 

Proof. The variates X, — X,, X, — X,,..., X, - X, are jointly normal. Further more 
Cov(X;, Х„) = (1/n) [Cov (X;, Ху) +... + Cov (X;, X,)] = c? /n. [Соу (Х;, X;) = с?, Cov (X;, X,)70,jzi 


Cov (X, – X,, X,) = Соу (X,, X,) - Соу (X,, X,) = (o? /n) - (o^ /n) = 0. 
It follows that X, SX X - X, are uncorrelated to X, and hence independent (joint 
normal distribution). Thus У(Х, — X,) and X, are also independent. This suffices to 
provide the result. 
Comments. Without assuming joint normality of X, — X, , the result has been established 
in $16-54. 


20-52. Rotation for Securing Independence of Variates 
Let (X, Y) - BVN (0, 0, a do. p) be a point in the XOY plane. Rotating axes through 
8, the point (X, Y) becomes (U, V) w.r.t. new axes. These are related by 


U = X cos 0 + Y sinO оа О cosO ѕіпе || x A Ча cos@ -sinO||U 
у= – ХѕіпӨ +Y соѕӨ V| |-sin@ cos0||Y Y| |sinO  cosO||V| 
Cov (U, V) = E(UV) =E[(Y’ — X?) sin Ө cos 0 + XY (cos? 0 — sin? 0)] 


Syy =0, = (E(Y?) - E(X?)] (sin 20/2) + E(XY) cos 20 = 0. 


tan 20 = 2p c, o,/(0? - 02) or Ө= (5) tan”! [2p6, с, /(o? ~ 9591. ...(1) 
Note. In obtaining (1), nature of BVN is not used. Hence (1) is valid for arbitrary variates. 
Example 1. Let (X, Y) ~ BVN (0, 0, 9, 4; p ?). If coordinate rotation through a = -л/8, 
results in uncorrelated variates (U, V), find p. 


2 — 
І 


2 
i 1j с с x 0—4 X 45. 
ашан. таа tan 20= 755 tan( z)- 12 


Example 2. Let (X, Y) - BVN (0, 0, o’, o^ -1). Find the transformation matrix such 
that (X, Y) — (U, V) independent variates. 

NT 
Solution. tan 20 = ru ED CS — —o => 20- -n/2 or 02- 72/4. 
9,-90; OGO0j,-0, 
| cos® ѕіпӨ| 11/42 -1/¥2]_ 1[1 -1 
— = аве eB] (042 423] Joli 1 
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90-60. Bevy of Solved Examples | 
Example 1. If X and Y are i.i.d. N(O, 1) variates, show that the m.g.f. of XY is 
per). ] «t «I. 


Solution. M(t: XY) 


E(e"' ) = E(E[e"" |Y]) = E(E[e ?* ] | y, [use M(t: X)] 


E(e! " ү, [Y? - gam (1,1) = X with m.g.f. = (1— 2t) 
н (1-21, (31). 
Important Note. M.G.F. of Z = XY, when (X, Y) ~ BVN (0, 0, o°, 0; ; р) 
Here Hy) = m, - p(0,/o5)y, Var(X1y) 2o? - p) 2 og, (X1y)~ Nm, 077 
M(t: ХҮ) = Б е^ }= Е(Е(е^ | y))  E(E[e "1 Y]) 


= Bate WT h [M, E p(s, lo), W = Ү/с, ~ N(O, 1)] 


o o cy 
E{exp n +112012) 6202), W? ~ xi, = gam (1, 2), 
2 


Boni en оту [ү 206, —61o? 0 - p?) P] ^. 
Example 2. Sheppard's Result. If (X, Y) is BVN (pj, н, с?, с? ; р), show that 


Р(Х >E(X), Yy>EW)}=4 + z sin"! p. 


Solution. E(X) = иу, E(Y) = p; put (x- p)/o, =u, (y - n;)/6, =v. Now 
E 1 co (ц? – 2риу+ v? yxi- р? ) 
p=P{X>p,,¥ >p.}= P{U > 0, V > 0} = ——— du dv. 
1 2 2n 1-р? iM Lis 


To evaluate this integral, let и = r cos 0, v = r sin Ө, du dv = r dO dr, so 


- 1 - 2 
1 ае [rre et ? (1 2рѕіпӨ cos 0)/2(1— p )dr 


XY Een d 
ye ел. can do М-р? m вес? 0 49 


7 2n % 1-2psinOcos0 2л 0 1+tan? 0-2ptanð 


=i "a E ) А [z = tan 0, p^ < 1] 


(z-p)*Q-p) 27 


= abs x x p Mr rd in^! 
д ЖА (р). 
Remark. The above result follows trivially if we appeal to the integral : 


1 һ 
© ew + 2һху + Бу?) —— COC OS .. 
bhe aad 2 (ab - 5?) Jab - №? 
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BVN (р, р, o^, 2g? 


) . B) 


Example 3. If X is Хү, o^) and Y | x is N(x, с>), show that (X, Y) is 
Solution. M(t,,t,) = Ее" кү IÍ E(E[e^** ^Y 1X = x]) 


= E{e'* E(e^" | x)} = E(e^* eka tion " [M(t:YIx)- m.g.f. of N(x, 6^ )I 


lg? lg? 2 : 
P t5 E(e ^ * X) „1° n .exp {u(t +t,)+40 (ti + t) } 


"^ e" +1›)+ 1с? (1? + 212 +211) 


This shows that (X, Y) ~ BVN (y, р; o^, 202; 1/42). (p - 1/2) 

Example 4. If (X, Y) ~ BVN (р, н, сү, су; р), і = 1,2, 3, n is a random sample of 
size n, find the joint p.d.f. of X =(X,)/n and Y = (ZYj/n. 

Solution. Let m(t,, tj) be the m.g.f. of X and y and M(t, 1) that of (X; Y). 

m(t,, t) = Efexp (t,X t Y)] = Е(ехр [Z(tX; / n) + (5Y,/m]V. [л /n7 Bi, 5 /n— 8] 


= E {flew (p, X, Bp reg" = TIM, B) =MG, BaT (7 (X, У) are i.i.d. vectors] 
i=l 


[exp (qu, B, + В, + (oii + 2po,0, pip, + opo] 


2 
d eut. 937 1 
=! 
"ТЕГҮ Уг 


This shows that (X,Y) ~ BVN (Uu 0; /n,05/n;p). 
Example 5. Let U, V, W be i.i.d. N(O, 1) variates and T be U(0, 1) variate. Define 


ХЕТ ЧУ. ПЕТ, Y=WVT+VJi-T. 
Show that X ~ №0, 1), Y ~ N(0, 1) but (X, Y) is not BVN. 
Solution. M(t: X) = Е(ехргХ) = Elexp (V TU +1J1-TV)] 


от 
exp iuf, + Ho 5 + [Si +29 


= E, (Ee!) Ee )IT =Const.} [Бу Double-E Rule] 


= Бре o I-12) gu) = nn 7", 


Thus, X ~ №0, 1). Similarly, Y ~ N(O, 1). 
M(t,, tj) = Elexp (t, X + г,У)] =Efexp [t, JTU)] Elexp (t; V T W)] E[exp (t, + t) J1- ТУТ = Const. } 
E; (exp (4717 + 1712 - 1(0) - T) (t, 5) ) = exp (t +t) /2) E,(c ^") 


exp [(t, +2,)2/2] (17 &)/11,. 
| This is not the m.g.f. of BVN distribution hence (X, Y) is not jointly normal. 
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Remark. Put t, = 0, use L’Hospital Rule for Indeterminate to recover 


M(t,,0) = expGt^) > X~N(,1). 
Evaluation of (1) is to emphasize an excellent technique. 
Example 6. Show that for standard BVN (0, 0, 1, p) moment recurrence relation is 
M, s ER 1 —DPu..,,., eur -D - 1)(1-р^) р, 5-2 
Hence or otherwise show that 


bey = З, =1+2р ш, =0, if r+s is odd. 


Solution. M=M(t,,t,)=exp EC + 2pt,t, + ‘t= Y yr nh AY 


Let suffixes indicate partial differention, e.g. M, = ôM /ôt,, Mj; = 0 M/Ot;0r,, etc. 
M, 


(t, - pt,)M, M, (t, * pt) М, 


М, = [p (t; + tp) (t, + pt) М =[р+ (+p tit, + p(t? + :12)] M. 
These relations immediately provide, on eliminating uL t 


My = [pt,M, + pr; M; + pM] + (1 - pt M. (2) 
We now use series (1), differentiating and substituting into (2) 
Ed viet gt! sl 
H,. shy b H,. 5 ti t 2 H, sf s*] D 
E aen +s+1)+(1- ————— 
i-i 1)!(5 – Te ne ris! re Аа M р 02. ris! 


Equating coeff. of (; 1; | /(r - 1) !(s - D' in the above Eq. we get 
= р{(к—1)+(5—1)+1}Н,-1,-1 -(ü-p ?)(r-1)(s-1) Ш,-2.5-2 


-(res- Don, „м t- DEDU) 5. NE 


(ii) Since X and Y are standard, o, = о, = 1. Also uj у = PO, 6; = р; Hoo = 1,50 
Bay = 3рџ, 5 Em 3p, B22 Ж Эри | + (1 y p # = 3p" * (1 =p at 1+ 2p’. 
To prove that p,, = 0, if + s is odd, we notice that 


Uso 7 Но, з = 0, Hi, 2 = He, , = 0, as Ho, у = =н = 0. 
So we proceed by Mathematical induction. 
If r + s is odd, then (r — 1) + (s - 1), (r- 2) + (s ~ 2), (г — 3) + (s — 3) etc. are all odd. 
Assume that Mo 15-1 = 9 9.2, = 0. Now by (3), р, , = 0; hence the inductive 
Process is complete and the enl fully established. 
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Example 7. If f(x, y) is the p.d.f. of BVN (0, 0, 1, 1; p), show that of /dp O° f /д, à 
If V= P(0 € T <x), W = Р(0 < T € y), where T is N(0, 1) ; prove that W and V are uniform 
over (1/2, 1/2). Prove further that А = Corr (W, V) satisfies the relation 

p = 2 sin (nR/6). 


Solution. Here f(x, y) = (2741 - p ү" ехр[—(х7 — 2рху + у2)/2(1 - p? )], (1) 
т f(x,y) = -n(2n,J1-p’)- (x? – 2рху + y’)/21- p^) 


Кол „ср, 2л p. ,o-enOo- p) |, A 
Зо CT Oy Пер 3" 07 oy 1-р? (1-р?) др 
Recall : F(X) ~ U(0, 1) and Z = [(b — a) F(X) + а] ~ U(a, Р). 

Here F(x) = (1/2) + V => V = [(1/2) - (-1/2) Е + (-1/2) = V~ U(-1/2, 1/2). 
Now E(V) = E(W) = [1/2 + (—1/2)]/2 = 0, Var V = (b – a)"/12 = 1/12. 


R= Ge, nue =12E(VW)=12 ff wv f(x, y) dx dy, [w & v are dep. function of x, y] 


dR Вт 
= 1 we аха = 12 wz dxd 
R = in jfw La dy= t2jfw 2T. dedy 
We integrate by a w.r.t. x and y and obtain 
dR © e zx Ban ‚= dad 
x wa — — dx dy, 
dp lr ж el Gar ase pes [NES x Bx | 


3 
i n^J1- p? 
л 


Recall : (^ [^ ex (ах? + 2hxy + by*)] dx dy = ———— 
ecall : [„ [„ exp[-( ES 


FÉ. E exp {-1(2- p?)(x? «y)-2px]/20-p^))dxdy — [by (D). 


dR — ^ пар). m 641- p 
dp ~ BG 4 ) 0-р?) -pl^ я 1р2) (4-р?) p) л wr р? 
Integration gives : К = (6/л) sin! (0/2) + C = (6/n) sin ! (p/2), 


since when p = 0, ; = 0, hence С = 0. Thus p = 2 sin (xR/6). 
Example 8. Let W and Z be two random numbers chosen from the unit interval. Show tha! 


cos 2nZ , sin 21 Z Jes) у. cos2nZ  Jsin2nZ | 


-20nW - 
J2d - p) разр) н = 2(1+р) 


are dependent N(0, 1) variates with correlation coefficient p. 
Solution. For neatness, let а = [2(1 + р) "°, b = [201 - p)| , 2mz = a, so that 


x z4-2Unw (b cos Ө + a sin Ө); у= 4-2 0n w (b cos Ө ~ a sin Ө) 


>. Ox, Ox, y) _ Уу —2 dn w (2л) 4-3 
Ow,z) 2w inw 


Х = Taw | еге 


bcos0 -asinO — bcosO +аѕіпӨ 
acos0—bsinO  -b5sinO0 —acosO 


| 
| 

Ld 
2 
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Add column 2 to column | to get ——— 


O(x,y) _ 4nb|cos0 bcosO-asinO0| 4mab|cos0 -sinO| 4xab 
Aw., z) w |sinO acos6+bsin0| у |sinO cos0| w 
This provides dx dy = (4л ab/w) dz dw, hence the joint p.d.f. of variates [f(w, z) = 1] is 
l. dw dz = (wyl—p? / 2n) dx dy. (1) 
2 2 aie. 7 ? ? 9] 
Now, x + у = (-AUnw) (a^ sinf Ө + b? cos? 0) = - 2 (Un w) (1 + p cos 20)/ (1 - p^). he) 
xy = (-20nw) (b^ cos? 0 — a’ sin? Ө) = — (n w) (p + cos 20)/ (1 — p^). (3) 
Also E [cos (2nZ)] = f) cos 2r dz - 0 =E [sin (2л Z)] ...(4) 
Е [соѕ? (21 Z)] = (2) fo (1+ 4 cos 4nz) dz = 1/ 2 - E [sin? (2nZ)] (5) 
From independence of W and Z, using (4), we conclude that E(X) = 0 = E(Y). 
Also fo (пу ди = [winw- w], = -1. X 
E(XY) = -(1- p°)’ E(inW).E(p--cos4nZ) »p/(1-p^) [Using (3)] we ey 
суу = E(XY) -E(X) E(Y) =E(XY) £0 = X and ¥ are dependent. 
Now, X^ = (-UnW) (b? cos? 0) + а> sin? Ө + ab sin 20) 


E(X?) = -2E(Un W) E[P cos? Ө +a’ sin? Ө + ab sin 20] [Use (5) and (6)] 
= 2) CD} P «$a +0]=а? +b - M - p). 
Var (X) = Var (Y) 2 1/ (1 p°); Corr (X, Y)-oy,/oy 0, =p. [by (7)]. ...(8) 


2 
2xy 
Eu 1 oravit 
she a) wem (1-p)Qr + y -2pxy) 
QO. y) =i" gy -2py0 - p) =z ib — 2px'y' = – Anw [x' = x/o,, etc.] [by (2) & (3)] 


This gives w = e 22") and substituting in (1) we get 
1 2 ~-O(x, y)/2 — 1 -Q(x. у)/2 
х,у) = «бш | b е = m e AARP) 
17) 2n 2n 6,0, 1-p 
This proves that X and Y are jointly normal with correlation p. 


Problems with Solutions Provided at the End of the Text 


1*. Let (X, Y) ~ BVN (0, 0, 67, су; p). Show that U = (X/o) – (pY/o), V = YJ1-p’/s, 
are independent Normal variates. 
2*. Determine the parameters for the BVN distribution ^ 
fix, y) = C exp (-[16(x – 232,12 уњ 3) + IO + 3) /216). 
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` d^ 


4*. 


9°. 


6*. 


7%, 


8*. 


10*. 


11*. 


12*. 


13*, 


Find Corr (X, Y) for jointly Normal distribution 


f(x, y) (214) ! exp (1022 у)? + 2ху)/6]; -o«x,yco 
Show that if (X, Y) is BVN (0, 0, 1, 1 ; р), then 
PIXY > 0) = 1+ п"! sin™ (p), — P(XY <0) = ! cos ! (p) 
If (X, Y) is BVN (5, 10, 1, 25; р), find p(> 0) when P{4 < Y < 161X = 5} = 0.954 
If p = 0, find P{X + Y < 16}. 
If (X, Y) is BVN (3, 1, 16, 25; 3/5), find 


(a) P3<Y<8lx=7), (b) P(-3 < X < 3 I y = —4). 
Random variables X and Y have joint p.d.f. 
Дх, у) = (бл./3)`! exp abr - - * tay ay -y+ Ji — 60 « X, y < o0, 


Find the best M.S. estimate of Y using X and the M.S. error involved with using 
this estimate. 

If (X, Y) is BVN (p, н», 07, 0; ; p), compute Corr (e*, PAT 

Let X, Y, Z be i.i.d. N(0, 1) variates and suppose U = X + AZ, V= Y + AZ 

(i) Show that U and V have BVN distribution and find A so that the Corr 
Coeff. is 1/2. 

(ii) With p being the same as before, what additional transformation involving U 
and V would produce a BVN (ц, H» o,, 07; p) ? 

Let both X and Y be mixed variates such that 


f(x, y) = kno, .0,41—- p°)" exp[-Q/2( - p')]; – 0 < x, y «o, integers omitted 


where Q = -m loi ]-2pf(x - ju) (У -m)0,0:]1+[0- uy 105]; f(x, y) -0, otherwise; 


p(x, y) = (") nd pq (1-p-4) =! (1I- k); x,y integers 
Find the m.g.f. for the pair (X, Y), Var (X), Var (X | y) and Cov (X, Y). 


Let : f(x, у) = Qx)'! е +7002 gu. ду” + ЭД, —o «x, y«o. 

Verify that f(x, y) is a p.d.f. and that each marginal p.d.f. is Normal. Are X and Y 
independent ? 

The distribution of two components measurement (X, Y) is BVN (p. Ho b E р). 
For the proper functioning of a machine, which uses the components, !! - 
necessary that some linear combination of X and Y can be obtained with unit 
variance and independent of X. Is such a combination possible ? 

If X- №, o,^) and Y - №0, с,:) have correlation coefficient p, show that 
Corr (x, ү?) = рг. 


14*. For (X, Y) ~ BVN (0, 0, 1, 1, р), show that 


(a) (X + Y) and (X – У) аге independent Gaussian distributed. 
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(b) X and Y are independent iff p=0. (c) Q- (X? 2pXY + У?)/ (1-р? has x}, distribution. 
15*. Variates X and Y with zero means and S.D.s 9,, с, are normally correlated with 
correlation coefficient p. Show that 1 l 
U = (X/o) T (Y /o,), ү = (X / Oo, )— (Y / 05) 
are independent N[O, 2(1 + p)] and №0, 2(1 — p)] variates. 
16*. Let (X, Y) ~ BVN (0, 0, 07,03; p). Show that, using conditional distributions, 


^ 


Var(XY)-0;02(1-p), Сот (Х,У) =p 
17*. Let Q(p) = (x^ – 2рху + yy – p), —o <x, y < and define 


f(x, y) = A41 - p^)" texp[-1Q(p)] + exp [-4Q(-p)]}. (1) 


Show that f(x, y) is a joint p.d.f. such that both marginals are №0, 1) but f(x, y) is 
not BVN. Show further that X and Y have zero correlation although X and Y are not 
independent. 


18*. Show that the normality of conditional densities does not imply that the bivariate 
density is normal (Gaussian). 


19*. If (X, Y) - BVN (0, 0, 1, 1; p), find E [max (X, Y)] and E[min (X, Y)]. 


20-70. An Alternate Development of BVN Distribution 
Def. A random vector (X,, X;) is said to possess BVN distribution, if for all а and b, 
Z= aX, + bX, isa normal variate. 


1. Moment Generating Function. Let E(X) = p, Var (X) = сї, i=1,2. Then 
и = E(Z)=ap, + b, o? = Var(Z) =a°o; +b’ oj + 2abpo,o;. 
Since Z ~ N(u, o?), M(t: Z)=exp [pt ior] i.e. 
M(t:Z)- ехр((аш + bu;) t +} (а o; + 2abpo, c; +b? с2) 2). 
or М(1,0) = exp {Hy л + Ho! * 16i fi +20616; ht, *0212)] (1) 


where at = t, and bt = t. Result (1) is the m.g.f. of BVN-distribution. 
2. Independence versus Correlation. This is proved in § 20-50, no change in new setup. 


3. Probability density function for BVN distribution. Let р> <1 and define : 


U= (X, -u/o,, У =(Х, - №)/ 92, W -(V - oU)A4f1 - p?. 
Obviously, E(U) = E(V) = E(W) = 0, Var (U) = Var (V) = Var (W) = 1, as p = E(UV), 
Cov (U, W) = 0. 
Since U and V are linear combinations of X , and X,, they have a BVN distribution. 
Also Соу (U, №) = 0 => U and W are independent [characteristics property of BVN- 
distribution] N(O, 1) variates, and hence their joint elemental p.d.f. is 
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dF(u, w) = (2r) exp [7-14 - Lw^] du dw. ~ 


ө 0 | 


or | = 


O(u, w) i "ea 
-p(o, JI - p^T' 19: ү(1-Р Г 


Since (x, Xp) 


| 
= | | Л Po 
| 9,0; ү1-р' 


dF(x,,x,) = (2no,0, 1-р?) exp[- 5 Q] dx, dx, 


where О = и? +?” = (и? — 2риу + у) / (1 -p’) 


pee ка ү 7.5 7 . X,— || х2 Н2 |, | 52 — H2 d Р 
1-р? ( 9, | hg 9, с; s 5; | v) 
From (1) & (2) we get the required p.d.f. for BVN (I4, 1201,02: ): 


fapt) = 'Q2n6,6, 41-9)» ехр[-10], -9 <, х, «o. ...(3) 


Note. Let Y, = aX, +ЬХ,,Ү, = cX, + dX; ; then aY, + BY, is a linear combination of X, 
and X, and hence (Ү,, Y;) has BYN distribution. 
Example : Let X and Y be standardized variates. Let Z = aX + bY, (a + 0, b + 0) be 


N(0, a? + ab b^). Obtain the joint distribution of (X, Y). 


Solution. A characterization property of normal distribution states that if Z = aX + bY 
4 c is Normal, then X & Y are jointly Normal. Here 


Var Z = a! o} « b ol *2abo, 0, py, =a * b^ + 2abp. 
Thus by hypothesis, 2p = 1. Hence the joint density of (X, Y) is BVN (0, 0, 1, 1, ; 1/2). 
i.e. Дх, у) = (43)! exp [-2(x’ + y! – xy)/ 3], -9 < x, y <. 


20-71. Linear Functions of Normal Variates 
Theorem. If normal variates X and Y have the joint p.d .f. 


Лх, y) = Qn J1 - p^ expia? – 2pxy + y')/ 20 - p); -0< x, y< 
then any linear function U = aX + bY of these two variates is also Normally distributed. 
Proof. We apply transformations of the type : и = ax + by, v = а'х + b'y so chosen that 


К(и? + v^) = х? — 2pxy + y’, (K = const.) 

P(U € и} = Jf., fo y) dx dy fe, [2 € "^" dudv=B fi, e" du 
If follows that U is normally distributed. 
Since E(U) = 0 ; Var (U) = a? + Ь? + 2abp, hence the p.d.f. of U is 


f(u) = [2n (a? +b? + 2abp)] "^ exp [-w? /2(а° b^ + 2аЬр)]; – © <и<% 
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Note. The deviation of the extension to general value of means and variances is straight 
forward. [Apply m.g.f. method also]. 
Cor. Any linear function of two independent Normal variates is normally distributed. 


Remark. Two normal variates may have joint distribution which is not BVN, in this 
case a linear function of these variables need not be normal [Vide Example 20-19(a)]. 


20-72. Cauchy Theorem : Ratio of Two Correlated Normal Variates 
Let (X, Y) ~ BVN (u,,u,,0;,05;p), then the distribution of 


_ (€-n)/o, U 
—fijic, СУЎ 


is fa = 41-9 /т[22 -2px 1, - <<. 


Proof by Double-E Rule. Let U = (X - u)/o,, V- (Y - u;)/o;, W- (V - pU)/41- p. 


Then U and W аге indep. N(0, 1) variates. Let Z = V/U or Z = UIV is similar. We offer 
two evaluations. 
(i) à(:Z) = E(el%) = Ее") -E(E (е U =u) -E(Ee"" lu =u) 


- Eom) -4 (1-0?) m? Т 


[Ү1х- Мы, + р(с, /с,) (X - ш); 95 (1—p*)]; for V lu, use p, =0 =u, 0, 70, si 
o(t:Z) = е” Efe 0-92 


Aw Pe Ee 
= P М е = ет“ аи, I ett = (Б /х а= YE e% a>0,b>0] 
Bon fe -Q2) - Ka - py’ 7/20?) d | 2 2 
А " u. a! =1/2, = 1р? 12102] 
EL | 
є Qr nie 


(i) $(:2) = Ele”) Бе) Eje" rnm] p Efe m] 


E ; rmt В ae ee 2 2 
e? .Ete" 1-р" М/О IU =и}=е"? Е{е 3! (1- p YU M6, (02e a 


ow 12)- (^ (0 - p yn Yu 


ty 
irj» е2 а-и gy zen Pe 
ге Jos e 
e- -inJi- p? [as above] 


This is the Ch. Function of a Canchy’ variate. Since Ch. Function uniquely identifies a 
distribution, it follows that 


A2 = J-P InTz - py + 41-р) —o«z«o. 


Comments. Evaluation (ii) is neater, it avoids the conditional distribution used in (i). 
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Note. When p = 0, this theore m corresponds to theorem 2, § 19-58. 

Cor. Distribution of T = (X ~ p,)/(Y — p). 

Put t =0,z/0,, i.e.z=t(0,/0,) ; = (с/с) аг and (1) reduces to 
J1-p? (с,/с,) ә, 019, ү1-р 


g(t) = 1 (6,79, yn - 20(6,/o, ve nfo à – 2p0,0. "P 31] 


A/n ([t - p(o,/0,)] + 3), A=0,J1-p’/o,, -»«t«o. 
This is Chy (рс, /с,, А), with modal value p(o,/0;). 


20-80. Price Theorem 
If (X, Y) is BVN (9,,15,0;, 0; ; р), then for any g(X, Y) : an arbitrary function of X and 


Y, and c= с,, 2 0,0, f. 


: 2. <P evt y) dx dy = е) 


-%0 


0" g(X,Y) 
ӘХ" ay" | 


Proof. By Inversion Theorem, — in terms of Ch. Function is given by 


1 «o. го 1175 4 
fe» le [е (t,t) dt, dt, (I) 
exp {i(t H; +t, H2 -l(oi t? +2рсус, t,t, + БЕЙ 0 


LTD sos Dos Г fe, e *5? б ,t,) dt, dt, dx dy. 


where $ (tit) 


E[g(X, Y)] 


Since only $(t,,t,) depends on c = ср -9,0;f; differentiating the above equation 
w.rt. “c” n times and using (2")/dc")=(-t,t,)" ф, we get 
PEED _ ре o SED p po m car eq, n) dide dedy 0) 


Oc" 
Also differentiating (1), n times w.r.t. ‘x’ and n times w.r.t. *y' we get 


д” f(x, y) 1 oo po n ,.-i(tyx t toy) 4) 
= — Zt t he "* (e t,) dt, dt A 
ax" ду" An? L Ls ( 1 2) ф( [2.72 үтел 
55 E(g(X,Y)) = гый P g(x, yp LED ка, [by (3) & (4)] 09) 
I. uf 
We assume that for | x | — oo» or | y | — о, the function g(x, y) — © too rapidly, i-e! 
а(х, y) |< A(e" **), n«2, then integrating by parts repeatedly we get 
00 ро o" fi, y) p g(x, y) (6) 
y) ———— dx dy = y) —2—— dx dy 
I. I. se» y = [I fe» 


SEIS Sr E i Exercises у 6 1 5 


M 
The stated result follows from Eqs. (5) and (6). SE er — ———— 


Example : Let sina = p, . in«axsim. If (X, Y) is BVN (0,0,67,02;p), then 


E(IXYI) = (20,0, / х) (cosa + о sina), 


Solution. In Price Theorem, put g(x, y) 


= | xy | to get 
д 
—Е(!ХҮ) =ҥЕ)4 „4 
дс | бах {лу 627 
But £ ixi ee cuu. o> 
=l <0 dyš +}, у<0 
pnma 
dx ау УЦ 1. POXY > 0) - 1. P(XY <0). (2) 


Since P(XY > 0) = 5 + (а/л), P(XY <0) =1 - (а/п), by Example 20-4 Eqs. (1) and 


(2) provide 
д Pi o c ie с C 
—E | XYI = — = — І .. = 
Oc dist n no” lem) (: а EA 


Integrating this rcsult we get 


с 
90,0, 


E(IXYI) = H u( Jac «(EQ ху... NEL 


When c = 0, (X, Y are independent), so 
EI XY! = EIXI.EIYI- (V2/n)o, (V2/n) 0, =20,0,/n. 


c 


A с mz C 
f; sin” Е св! + 4o? o} -c — 9,0, [a sina + cos a. - 1] 
отс? 615; 


0 


Making substitutions into (3), the given result follows. 


Exercises 


1. If X and Y have joint p.d.f. of the form 


fa. y)» K exp (-1[ay (x - b + za; (x - b) (y - c) + ay (Y - cy]. -o«x, y«o. 
Find K and also Corr (X, Y). 
2. Find the Five parameters of the BVN density 


G) fü, у) = (От)! exp[-1 Qx? + y + 2ху - 22x - 14у + 65] 


(i) fu, y)= (2m)! exp[-1x? - 1y! -2x + 3y - (03/2)]. 
3. For the BVN (1, 2, 42, 5? ; 12/13), find P(X > 2) and P(X > 21 Y - 2). 
4. For the BVN (60, 75, 6°, 12? ; 0.55); find 
()P(65«X«75), (ii) Р(71 <У<801Х= 55), (ii) P(1X-YI2 15). 
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5. 


6. 


7» 


10. 


11. 


12. 


13. 


14. 


For the BVN : fly, y) = k exp d -(2/3) (x? - xy + y! Зх + Зу + 3)], find the marginal distri 
of Y and the conditional distribution of Y given x. 
If (X, Y) is BVN (0, 0, 1, 1 ; 0.8), find the p.d.f. of Z= X -Y and identify it 


(a) If (X, Y) is BVN (0, 0, 1, 1 ; p), prove that P(X » 0, Y» 0] = i+ (2n) sin" (р) 


(b) Let (X, Y) ~ BVN (0, 0, 1, 1 ; 0). Determine the radius of the circle S with centre at (0, 0j зц. 
that P((X, Y) e S} = 0.95. 


(a) If (X, Y) is BVN (0,0,07,05; 0), (A 2 05/0,), show that 


ps P(IXI&IYI) = (л)! tan! (2A, J1-p? /(1- 27)]. 


Hence show that, irrespective of the value of p in its permissible range of variation, p > or < 
1 according as с, « or >0,. Try to generalize the result. 


(b) Let (X, Y) ~ BVN (0,0, 0°, o? ; p). Find the distribution of Z = X/Y and use this result to 


show that Р(Х <0, Y > 0) = (1/2) P(XY «0] = (2x) ' cos ! p. 


Let f(x, y) = K exp [educi 6xy - 9у?], -0 «x, y<. 

Find the constant К, Cov (X, Y) and the conditional distributions f(x | y) and f(y | х). 

A manufacturer of quality electric bulbs rejects bulbs for which a certain quality characteristic 
X of flament is less than 65 units. The quality characteristic X and the life (in hours) Y obey 
BVN (80, 1100, 10°, 100°, 0.6). Find 

(i) The proportion of bulbs produced that will burn for less than 1000 hours. 

(ii) The proportion of bulbs that can be put on sale. 

(iii) The average life of bulbs put for sale. 


Let f(x, y, 2) = Qn) "^ exp [-4 (x? + у? + 27)] {1 + xyz exp [-4 (x? + y? + 22)]) where-9 «x.» 
г< œ. While X, Y, Z are obviously stochastically dependent show that X, Y and Z are pairwise 
independent and that each pair has a BVN distribution. 

For (X, Y) - BVN (0, 0, 1, 1 ; p) define a variate V whose values are 1, 2, 3, 4 respectively 
depending on which quadrant the observed value for (X, Y) lies in. What is the p.m.f. of V? 
The height h and weight W of a group of people are approximately normally distributed with 
mean weight 140 Ib, S.D. 12 Ib, mean height 68", S.D. 4" and correlation coefficient 2? 
Given that an individual is 66" tall, what is his expected weight ? 


Let (X, Y) be BVN (0, 0, 1, 1; p). Show that the area of the ellipse 
(3101) - 2р(ху/оцсз) + (у? / с) = X 


-3/2 


of constant probability density is 122 0595 "TT = p^; and hence that the area of strip between 


2 
the ellipses corresponding to the parameter values A and À + dd is 27А. 002, Р i 


Deduce that the probability that a pair of values (x, y) chosen at random, will be repr ри" 
by a point inside the strip, is 


exp [-A? /2(1 - p?)] Adv (1 — p°). 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 


26. 
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Hence by integrating the probabilit iudi nr 

y that th t wil 
[~<A ? X1 -0 “yi. e point wi ] fall fide the ellipse Nis 1 — exp 
Also show that, for a given value of dÀ, the probability that the point (x, y) will fall in the strip 


between the ellipses X and А + dd is maximum when 22 = 1 — g. 
If (X, Yo is BYN (10, 20, 16, 100 ; ; р) and E(Y | x = 15) = b, find k such that 
P(b — k «Y «b - к} = 0.95. When (i) p =-0.5, (ii) p 2 0.1, (iii) р = 0.09. 


An object tends to fall on a point target, without systematic error. The distribution about the 
target is BVN (0,0, 0°, с> ; 0) . Construct a circle and a square, of equal area, centred on the 
target. Show that the probability is higher for the circle. 
Let (X, Y) be BVN (J,,15,0;,05; p). Show that Z = aX + bY + c is N(ap, + bui; +c, 
12 
асі + 2abpo,o, + b’o3), where a, b, c are constants. 
Let X, and X, be i.i.d. N(0, 1) variates and suppose that 
Y, = a, + bX, * b X,, Y, 2a; + bj X, + b X,. 
Show that Y, and Y, are dependent normal variates and find their variance and covariance. 


Let X and Y be i.i.d. N(0, 1) variates and suppose that U = X + Y +Z, V= X - Y € 2Z. 
Show that U and V have BVN distribution, find Corr (U, V) and E(U | V= 1). 


If (XY) is BVN (И.Н, b: с> ; p), find the necessary and sufficient condition for X + Y and 
X — Y to be independent. 


Let (X, Y) be BVN (0, 0,67, 62 ; p). Find the constants a, b, c, d, s.t. aX + bY & cX + dY and 
1.1.9. N(0, 1) variates. 
If (X, Y) ~ BVN (0,0, 62,02 ; p), show that U= X/c,,V = (1-р?) ^ [(Y/o,) - (pX/o)] 


are i.i.d. №0, 1) variates. 


Let (X, Y) ~ BVN (ц, H2, 02, 02 ; p). Show that U- X - p, V= Y - p, - poj с(Х- Ш) 
are independent normal variates. 
Unit steps are taken to the right and left (independently) with equal probability. Let $, denote 


the position after n steps. Show that the joint p.d.f. of (X, Y) where X = Saida and 
Y =(S,, – 5,)/ Jn is asymptotically BVN. 
Let (X, Y) - BVN (0,0, d с> ; р). Show that rth cumulant, (i.e. semi-invariant) of XY is given 
by к, = 1 (r – )!67 с5 [(p +1)’ +p- 1)’ ]. Deduce that 

Е(Х?Ү?у= в? o2 (1+ 2p’). 
If (X, Y) is BVN (11), 12, 02,02 : p), prove that 


ay 1 fe 
H, s = 0j 05 x()a-»» Í vj Vps- j Where v, i. 
j 


-1? 
ae 


dx. 


Hence show that H, , =0 , if r+ sis odd integer. 
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27. (a) Let (X, Y), | Sj Sn be i.i.d. variates with zero means, variances g? and 0; and correlatio 
| 


coefficient р. Show that the limiting distribution of [(o, Ул) | EX, (ovn) DA 15 standard 
BVN distribution. 


(b) Let (X,, Y,), (X,, Y,), ..., (X, Y,) be a random sample from BVN (0, 0, 1, !, p). Find E(Z) 
where Z, = 1, if (X,- X) (Y, -Y) »0;Z, - 0, if (X, - X) (Y, -Y) «0. 


28. Let (X, Y) by BVN (n,,1,,02,02; ) with р, > с,. Show that to a chose degree of 


241/2 


approximation, P{(X/Y)<k}=@(g), where g = (ku; – u,)/(o; — 200,0; + 03)". 
29. Let X and Y be N(0, 1) variates. Show that 
h(x, у) = f(x) (у) {1 + а [2F(x) - 11200) - 1), lal < 1 


is a bivariate density function with X and Y as its marginal densities. Show that Z = X + Y is not | 
Normal except in the trivial case Ө = 0. Here f, g are the density functions and F, С are the 
c.d.f's. of X and Y respectively. 


al 


2 


2 
S5. Given: Г = To Ł, (c = 0.6745 from Tables). Let 
т 


Аџ= (G5 у):х>с,у>0}, А, = ((х, у):х<-с,у>0), A, = (х, у), -c «x «c y < 0) 


Let fix, y) = x^! "x d +Y) (x, y) eA, U A, ВА, ; fü. у) = 0, otherwise. 
Show that f is a 2-dim. p.d.f. which is non-Gaussian with Gaussian marginals. 

31. Letf, (x, y) and f(x, y) denote respective BVN (0, 0, 1, 1 ; 0) and BNV (0, 0, 1, 1 ; p) densities. 
Suppose (X, Y) have joint density f(x, у) = > f, Gc, y) + 1 fo (угу). 


Show that X and Y have Gaussian marginals, but the joint density is normal iff р = 0. 


The only human Institution which rejects progress is the cemetery: 


ИИОНУ КАДОН 


Science is the belief in the ignorance of the experts. (R.P Feynman) 


Chi-Square Distribution 


Introduction. In this chapter, we introduce a special case of gamma distribution called 
chi-square distribution, that has earned the distinction of a basic sampling distribution. 
We present here the theoretical fundamentals, the wide variety of its applications may 
be considered later on. 


Note. Some authors write Chi-squared distribution instead of Chi-square distribution. 


21-10. Basic Definition 
A random variable X is said to be chi-squared distributed with n degrees of freedom, 


written X - Xo , If its p.d.f. is given by 


f(x) = e 00 pes ey ra nm O«rco5 f(x) = 0, otherwise. 


2 
х -Distribution 


= 
See а 
-m 
————— — — 


21-11. Theorem : Sum of Independent Squared Normal Deviates 

If Z,, Z,, ..., Z, are i.i.d. №, 1) variates, then (Z? +72 +...+ Z;)- Xo 

[n is the number of independent variates, hence called degrees of freedom (d.f.)] 
Proof. If Z is N(0, 1), then the m.g.f. of : is 


-4z -(1-2t en : 
M(t) = E(e7 )- Г m det [enge = dia ü- xy" re = au} (0-22? =) 
л 


=ч зү?” [^ Area under №0, 1) is unity] eta) 
Since Z,, Z,, ..., Z, are i.i.d. it follows that 
Ма:2 +23 +..+7,) = IM/(ZDI 20-207, [by ()] tt? 


This shows that X = DZ) i is gam (4,47); hence p.d.f. of X is 
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-1/2 (п/2) ~ 1 
e X » „ 
(х) КЕРСЕ а а 0 < Xx < 00, [1.e. X ~ а 


Cor. If X is x2, , then Y = 4X is gam (75,1) = gam (7/2). 


Proof. Put ix y, 0« x «o = 0 « y < ©, dx = 2dy. Then (3) gives 
e" (2y)"»- 2 me? si 
ДО) = (2)"?. Fh ENIM we 


0«y«o. 
This show that Y = 4 X ~ gam(l, 4n). 
Remark. Some authors define y7,-variate by the relation 
tio ri Elend utto [Z ~ №00, 1), i.i.d.]. 


21-20. Moments of X^ distribution and Recurrence Formula 

] e -(x/2) |, (n/2)-1 -(x/2) + (n/2)-1 

= E(X") =f ак ре LA d 
ran." ("T (An) 

= (2) I(in-r)/I(in. 


Using I(k+1)=kI (k), this gives 


2 
и, = ту: ег, 


Ta 75) 


= (п+27– 2). 


- 


u! = (+272). 
Obviously, this provides: pj=n, p}=n(n+2); Var (X) = u,- ш? =2n. 
21-30. M.G.F. and Pearson’s Coefficients 


M(t:xÀl) = 0-207", MGt:yt,) 2 (0.-2i) "^. — [88-16(12)] 


К: X) = (nMQ:X)--intn(0-20- 1n Y, СЕС Bo aes 


r=| F 
Thus, k,2n2' '(r-1) !. [Coeff. of f/r ! in K(t)] 
Observe kik, = 2k; 
In particular, К, = п, К, = 2n, k,- 8n, К, = 48n. 
Obviously 2p, - 3p, - 


түл» ay" = S(t RAT Ja» 


r=0 


Iz ТЫ а= 4, T@)| 
д“ 


J 


A 


mU 
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‚ | à; 
_ > D (5n r) oy f! 
id iiu 2) "lr! 
This gives : и, = 2’. '(in4 ғ)! (in). [821-20(1)] 


Pearson 5 Coefficients. As uj =k, =n, p, = k, = 2п, ц, =k, =8n, ц, =k, + 3k; = 48n + 12r 


? А L 
P 9 ^ш В paira = =È: Т. =. 73e =. 


n » 
Standardized X -variate : Q =x? - п) / 2n. 


31-31. Central-moments Recurrence Formula 


Bu = 2r(u,+np,_,), rz]. 
Proof. Me:y = 0-20";  MG:X-m-e"(-20"^. 
We denote the central m.g.f by m(t); take logarithmic differentiation w.r.t. “Т” to get 


m'(t) Tale n _ 2nt 
m(t) | {= f= 


Ünm(r) = —nt – inUn(l- 20), 


(1 — 2t) m'(t) = 2nt m(t) 
We differentiate this equation r times w.r.t. “т”. use Leibnitz Rule to get 


(1— 20) [m()] * +002) ma)? = 2nt [m()]" +r .2npmQ)" ? 
Putting t = 0, using m (0) = p, ; we recover : М,,, = 270 gi 9). 
Example : Let Y — X? where X is N(0, 1). Calculate E(Y) by two different ways. 
Solution. E(Y) = E(X*)=Var(X)=1, [X ~ №0, D] 

E(Y) = Ех] = Mean of chi-square with | degree of freedom = 1. 
Remark. We need not use fy(x) and f(y), since the results are too well-known. 
21-32. Reproductive (or Additive) Property 
If xX ~ bus and Y - dt are independent variates, then X+Y~ a 
Proof. Since X and Y are independent variates 

М: Ху) = Mtt: 30 Mg:Y)-0-20"^ 0-2"? = (1 aes 


This Shows that (X + Y) is кысу 
Extension to n independent x. - variates is obvious. 
2 
| Cor 1, iy X ~ у? Lr - xl, are independent variates, that (Y - X) ~ Xn-n: 
| | m) ? n 
Provided x and Y — X are independent (n > m). 


| NN 
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Proof. Write Y = X + (Y - X); then since X and Y ~ X independent. 
M(t: У = M(t: X «(Y - X)) M: X) Mi:Y - X) 


(aon 0-20 "*: MinY - X). 2 MG: Y - X) 20-720 "7 
This shows that (Y — X) ~ Xin- m): 


Cor. 2. If X is Xin» X * Y is е where X and Y are independent, then Y is y^ . 


Proof. M(t: X+Y) = M(t: X) M(t:Y) (^ X & Y are indep.) 
(1 2% ру - (1 e Dry E M(t : Y) — M(t Y) = (1 - 2/1) aig 
This shows that Y is x; 


Remark. Converse to reproductive property holds in the following sense : 


If X ~ 78А {= Ж ‚(Х+Ү)- icol , then X & Y are independent. 


21-33. Fisher's Approximation 


For large values of n, Xin)  N(n 2n). 
Proof. Let Y -(? -n)/ 2n be standardized x^-variate. Since ф(г:ҳ2) = (1—2й) "^, hence 
à(r:Y) = etr: G2 2i 2n] = e"? 6 (1H 2n: y?) = e"? [1- Qin] 2n] "^. 


Taking logarithms, we obtain 
(nó (t:Y) = -itn/2 - 1nUn[1 – i(2/n)"] [Assume V2 t <n] 
var sp г12 CC rh 
Pe cers (2) Yel ijt wy (2) . 
ru put? FAN ГЫ *3^2. r \n 


As п — ©, all the terms in the infinite series vanish. Hence using continuity of (л function 


lim ng(t:Y) = -4° => lim Коа. 
no п o 

This shows that when 7 is large, Y= ҳ>* is №0, 1) or equivalently X is N(n, 2n). 
Remark. That expectation and variance in the approximating normal variate depends 
on n is of great disadvantage. 


Aliter. Let Y; - ti 1€ j<n be independent variates. By Addition theorem E wy, +. + f 


; iT. 
is X^ with n degrees of freedom. Since E(x?) =n, Var (x7) =2n, БУ cL 


S* = (y? —n)/ /2п converges weakly to N(0, 1), which is equivalent to the fact that X 


is N(n, 2n) for large n. 


——————— — .. 821-41. Mean Absolute Deviation 623 


21-40. Mode. Points of Inflexion. Pearson's Coefficient of Skewness 
We set К = [2^7 l(in)|' ; then p.d.f.of X2, is y= Ke"? y"n-! greg 
Я пу = nK -4x + (1л – nx. 
pifferentiating W.r.t. "x", writing y' = (dy/dx), etc. we get 
Oy) = -3*0n-0nx 5 (у"/у)– (уу) 2-dn-0nx*. (1) 

Putting у = 0, we get x = n -2. And atx 2n - 2, п> 2, y" <0. 
Hence the modal value of a хг, -variate is at x = n — 2, n > 2. 
Inflectional Points. Now put y" = 0 and eliminate (y'/y) between 1(а) and l(b) to get 

ES. [n-2 | : 2 1/2 

20 E rn => [x-(n-2)| =2(n-2) > xz(n-2)£[2(n-2)] <. 


Thus, the points of inflexion are equidistant from the mode. 


1/2 
Skewness. ME Mear Mod E кё е (2) 


Since S, > 0, it follows that ҳо, is positively skewed. 


21-41. Mean Absolute Deviation 


For x2,f(x) кез“?! [К = 2" [Ga], x>0 and E(X) - n. At) 
M = E(IX -nl» f, (п x) f(x) dx + Ji, Gc — n) f(x) dx (d) 
0 = E(X-n)- |, (x п) /(х)ах+ | „„(х- п) О) dx (ii) 


Subtracting (ii) from (i) gives 
М = 2], „(п- х) f GO dx -2n[, f(x) dx 2 |, x f(x) dx (2) 


We now consider the second integral, integrate it by parts and get 


fo xf (x) dx 


E n /2)-1 ,-x/2 
Kf P ani e "dx = - 2Ke “ңүз +nK f, x" ) e x2 dx 


-2Ke"^. (п)? +n Jj f(x) dx. [by (1)] 
Substituting this expression into (2), the two integrals involved therein cancel out, 
We are left with 


M = AKe "(n)" = Же Сума МИШ т (in). 
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21-42. Worked-out Problems 
(0, 1), show that Y = -2 (п X i. 


Example 1. (Pearson's P, -Statistic or P,-Test). If X is U qd, 
Show further that if Х,, Х,, ..., X, are i i.d. U(0, 1) variates, and P = X, . X, X 
(product of variables) then — 2 dn, P is Жүр 
Solution. М(2:У) = E(e’)=E(e%*) =Е(Х") = f; x "dx = 0-20)". (i) 
This shows that Y is yo. Further 
ЭР = -20n(X, Х,...Х,) =} +} +... + ү; [Y; 2-2!nX]]. 
M(t : -2 în P) = M(t:Y, +Y, +. +Y) = [Mq Y)" 20-20. [by (i)} 


This shows that -2 (n P -xo. 
Note. The P,-Statistic is useful in combining several independent significance Tests 
of Statistical hypothesis. 

Example 2. If X and Y are i.i.d. Unif(0, 1) variates, show that 

1/2 


U= (-20nX)" cos 2nY, V = (-20n X) ^ sin 2nY [Box-Muller Transformations) 


апа i.i.d. №0, 1) variates. Deduce that U^ and V? are i.i.d. esis variates. 


Solution. Let и = (-20nx)"” cos 2ny, у= (2 0п x)'" sin 27y. (1) 


1/2 COS 2пу 
l= Ou, v) _ ШШ! 2x 


? = . 
O(x, y) (-2/0n x)? m 2n (-2Un х)!? cos 2ny 


Thus, dx dy = | x/2n | du dv. From (1), we also get 


ИЖ x 
—2n (-Un х) < sin 2xy 2x 


ц -y = -2inx > x=exp [-2 (и + у> )]. 
Since X and У аге 1.1.4. U(0, 1), their joint elemental p.d.f. is dP, (х, у) = 1 dx dy which 
under the transformation (1) becomes 
dP, (u,v) = (x / 2л) du dv = (2x)! exp [1 (0 + v!)]dudv, -œ < u , v < co. This i5 the 


joint p.d.f. of two indep. N(0, 1) variates. That is U ~ N(0, 1) and V ~ N(O, 1) are 
indep. variates. Since U and V are indep. so U^ and V? must be independent. Further, 


[N(0, D]! ~ x2, so U?’ ~ xz and У? ~ xi are iid. 


Example 3. If X ~ у, and Y - X5, are indep. variates, find the p.d.f. of U = aX + А} 
(a » 0, b » 0). 
Solution. The joint c.d.f. differential of X and Y is 

"uud add Ж Xx л, NU 


dF(x, У) = Toya” r(.7 
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pet = ах + by, v = ax/u, so that ax = uv, by = u(1 whe 


‘yy, Dsu< ою Осу < 1, 


O(x, y) | 


O(uv) ^ ab 


Ё и 


—U lu 
=—, dxdy=— 
ab 1 


The joint c.d.f. differential of U and V, using (1), is 


{| 
du dy. 
) 


al 


I-v -u 


та -ul2b m+n- Tem ч ч " 
dF(u, v) = (Ke u 1+л- | du). (v" l (1 = y)" | е“! є)у/2Ь dv) 223 


sere K = a"b"2"*" I (m) T (n), and c - (b/a). 
To obtain the p.d.f of U, we integrate out the unwanted variable v in (2). For this, we 


use exponential series e° = Y(0'/r!), assume term by term integration to infinite series 


and obtain 
l m-l n-1 E (u/ 2by (1 -c) . у" E. и ‘ (1 -c)y l т+г- n-1 : 
[у i= v) а 5 т) hv '-v)"'d 
RT uy ^or din tr) Г(п) 
EN 2 (+) in r! T(m+n+r) "en 


Inserting (3) into integration w.r.t. v of Eq. (2) we get [А = m + n + r] 


dF(u) d £o 1 $ pase pa lcs ey Г(т+ ғ) je=2| 
du ^ Va) Т(т) \b 2^ T (A) r! а] 


c" oo Г(т+ ғ) ч MU (u/ 2b)! н 
aro > ——— — (1- c) "dup С [А= т+ лп + р] 


г=0 r! 


fy (u) = 
Note. M(t: и) = M(t:aX + bY) = M(at: X) M(bt:Y) = (1 2а)" (1— 260)" 
= às ч e Ж ) á Ka ) (Ошу Qbty. Simplify and identify. 


Problems with Solutions Provided at the End of the Text 


l*. Show that for 2 d.f. the probability P, of a value of х? > хо is exp(- 1x5) and 


hence that x5 = 20n(1/ Р). Deduce the value of xo when P, = 0.05. 


If X 2 2 is the unique mode of gam (2, A) distribution, find the parameter A and 
evalutate P(X < 9.49}. 


2%, 


“af If X is “е апа N is geom (р), find the unconditional m.g.f. of X. 


2L. 1 
1-50. Chi Distribution 


finition, The positive square-root of y^ with n, d.f. is called the Chi-distribution 


" 
"hn, df. and is written x, Thus Xo) VX: 
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, y/2 ,CU2) ~ 1 
Density Function. F(x) = P(x) 5х) = Р(х $ "= —— 2 
Жубу Тел әл 


Differentiating under integral sign (DUIS), using f(x) = F'(x), we get 

f(x) = e" " (x2?)9»-! 2x1 (y " T(n/2) х>0 

f(x) = 2x" eo? Iran) Qy", x»0; f(x) = 0, otherwise 
Simple Moments : 


"ye ———u [° uiae "ы eal e^ dz. [z21x!] 
T(1n).Q)"^ ^ Г (in)” 139734 


pe = Q^ Timer ЕШ Gn)’ [Reverse factorial power] 
Thus, E(x,) = vn, us =E(x2)=n (mean value of х2). 
Example : Show that, for large values of л, E(7*)=(E (x, Р. 
Solution. We know that, и, =(/2у G n)? So, р -E(,,) = Vn 25 [EG] 2n- EG). 


21-60. Quotient Theorem : Ratio of Two Independent Chi-square Variates 


If X - x?,, and Y ~y are independent variates, then (X/Y) ~ Bj (4 т, in). 


Proof. Recall : x2, = gam (1n, D), Xim) = gam (уп, 5). 

By 8 19-33, [gam (a, А)/ват (b, А)] = By (a, b). 

Thus, 2,512) = Ba im in 

(Reproduce the derivation) 

Example 1. If X ~ №, O °) and Y ~ Muy, с2) are independent, derive the distribution 
of Z = (X - uK(' – Н): 


ia [aure T (80) s 91g „71 NOD 


Solution. 
oluti (Y—p,)/5,| Vo? с2 22 TNO, D) 


where Z; is №0, 1) ог equivalently Z? is Xu, Thus, (02/0;) 22 is the quotient of 'W° 


independent y^ variates and hence is a By (1,1) variate. Consequently, the probabili 


differential is 


жол. di. ini „— 5А аг 82 pa. D^ 
BG) [1+ (0222/01) (о) а). 5. с! 
dF(z) = 0,0; dz ‚ 0 <2<09, [Cauchy (0, с/6;)] 


$21-70. Chi-square in Terms of Sample Variance 627 
Aliter. See Example 16-27. 


Example 2. Let X, Y, Z be independent y7-variables with 2a, 2b, 2c degrees of freedom. 


X/2a ZI 
Prove that U = Y/2b' - 


are independent F-variables. 


M (X+Y)/(Qa+ 2b) 
Solution. Recall : If X ~ F(2m, 2n), then its p.d.f. is 
n 1 (mx | n)" ^! (n/ т)" 1s 
mne: = = е ——— D 
fO = Bonn) [1+ (mx/n)]"*" В(т, п) Vici. 0) 
Now the joint p.d.f. of X, Y, Z is 
-(x*y*z)2 .a-l b-i _с-1 
e cx 27 Uk ay dz 
dx, y. 2) = ss _;» 0 z "e. 
К" T (a) rb) r(e) Q)^^** ERER? . 
bx ad a+b z a l b 24 
— = Ө =, Ша =ст=н = = = == A= 
Put u a y Ф У үзүр” ar ke © "ГӨ DX 7 
Му | (и, v,w) v0 


Then x= 


uw = = 4 ies С x) f£" 
26-5 > EAD e ыы занай ulus 


The joint distribution differential for new variables is 


"Ox»2 y 


-w[1 + (44v)2 Laur ji 50у b*1 a 
Pe a) аы 1 du dv d ...(3) 
) Г(а)Г(Б)Г(с)2°*°*°© Е bom NETS. e 
We integrate out the unwanted variable w in (3) 
T (a4 b«c) Qy**** 
co  —w[I«(X/v)y2 „а+Ь+с-1 = 2——————————————_— 
É € Ww dw [1 $ (2. / эбе ...(4) 
Using (4) into integral of (3) w.r.t. w we recover 
Q^ и“! du d y^^! dy 
-| L | n | 0< ғ et 
iM. (ке JI Ba*boQe»m hh) co ©) 


Where B(I, m) = Г(Ї)Г(т)/Г(1+ m). 

Result (5) implies that U and V are indep. variables (by Factor theorem) with 
F-distributions as guaranteed by (1). [See 822-40] 

71-61. Sum апа Quotient of Independent Chi-square Variates 

ы amy, and Y uitis are independent, then U = X + Y, V = X/(X + Y) are independent 


2 
Kmsn) and B, (4m,4n) variates. 
ш: E = gam (2 т, 1), ы = gam (їп, 4). [Exploit §19-25 Example 1] 


ы Chi-square in Terms of Sample Variance бе | 
Xp, ..., X, be a random sample from N(p, o^). Let n$ = X(X,- Ху, 1 5j $n. Then 
! п52/с? ~Xin-1- 

= ир 


62 8 Chi-Square Distribution 
Proof, Observe X m (ZX,)/n » У(Х, Х)=0, Is /<1 
L(X, — p) ДХ - X) * CX TUR [ZCX , Ху ]+ их – n), fuse (1)] 
Dividing (ii) by a’, putting nS’ = У(Х, - XY. we obtain 
2 Р 
5 E "| = ns” + (2 Hu | ог W? = 6 + Z? (with obvious notations) 
mw с? \o/vn в? 
The term W° on the L.H.S. of Eq. (1) is %2, being the sum of л indep. М(0, 1) square 
variates. Also Z = (X ~p)/(a/ Jn) ~ N(O, 1) so that Z’ is Mc: Further, n5$^/o* and 
n(X ~ u)’ / o? are independently distributed variates. 
M(t: М) = М1: (152/62) + 22) = Mt:n$2/0)) Mt: Z?) 
wi (1-21 = Mirns o) A-U" => M(t:nS?/o”)=(1- 21” 
This proves that (п5? /9?) - X2, y. 
Note. nS? = (n- 1) ? = X(X, - Х)?,1<1<п. Thus (082/2) 2, where v=(n- 1). 


21-71. Distribution of Sample Variance 5? 


-(n-1)2 
8° Ht 22 2 2в? i 
_ ору 002 = MiS): Jewess (1-226) 
(1-20) | = " (0:5) т 


This shows that $^ ~ gam [n/26?, (n — 1)/2]. The p.d.f. of Y = S? is thus 
(n = 1)/2 e 1e X у)" - 3)/2 


п 
i Ba (z) ИША oc 
Cor. M(t: v$* 10?). M(vtl в: S?) z (12-250 7 => M(0:$?)- (1—260/ vy “С”. 


This shows that $? - gam [v/2o?,(n- 1)/2]. The p.d.f. of Z= $? in thus 


wena Jt 24 „(п-3)/2 
n J exp [-(n - 1) z/ 26*].z og Ду, 


ло = (SS FT - 072] 


21.72. Worked-out Problem 
Example : Let X, ~ N(y, o°), 1 <i < п be indep. U = K'E(X, 40?) and V= X(X, -Uy!9» 


NU. 
where K = X(1/62?) are independently distributed. Show that U is Normal and V 15 Ай 
$ 


‚А 
Solution. Since U is a linear combination of normal variates, U itself must be normal 
E(U) = K"Z[E(X)/o?]- К”! AZ(1/02) = р. 


__$21-73. Matrix-grid Theorem 629 
Var (U) = 


K^ X[Var(X,)/o*]- K? S(1/02)=K". 

so U- Np. K), or VK (U - p) ~ М, 1), i.e. W-K(U - p)! - y 

n (X,-w)-U-wl «(X -p 

Ez i и 
і = | і 


с | +@-ю°[—|-2@-ь} VLLET 
б i=] G; 


t 


on 1) 


i=l i 
= ZZ! + KU - p)’ - [XU - p) [KU - uK] =Z- KU - uy]. [Z= 22] ati) 
« V=Z-W, where Z~y/,.,W~x/,, by (1) and (2). 
So Mt: V + W) M(t:Z) => M(t:V).(1-21)'? 2 (1 20у"? .[V & W are indep. ] 
Thus M(t: V) = (1-20 ^? => y-x? 1. 


Problems with Solutions Provided at the End of the Text 


1*. A random sample Х|, X}, ..., X, of size n is selected from N(p, 1) population. 
Later an additional independent observation X, , , is obtained from the same 


population. Find the distribution of (X,,, — u)? + Y (x, - Xy. 
izl 


2*. If X,, X, ..., X, is a random sample of X, show that E($?)- g?. Does this imply 
that E(5)- o, when X is Мр, с?) ? 
3*. Three samples of sizes лү, n, n, are drawn from N(p,, с), i; 203, 2; Do Let 


U= $2152, V= 52 / $2 whre §? are sample variances. Find the joint density of U and V. 


21-73. Matrix-grid Theorem 
Let X,, X,, ..., X, be independent №0, 1) variates. Suppose 


bX, + bX; +...+b,X, =0, i21,2,..m. 41) 
The distribution of. X? + Х2 +...+ X, subject to m(« n) independent linear constraints 


(isa x distribution with n — m degrees of freedom. 
Proof. The coefficient matrix B of m constraints is of order m x n and hence its rank 
15 m (it has m independent rows). By Gram-Schmidt Orthogonalization Process, the 
Matrix equation BX = 0 can be transformed to AX = 0 where А, , , consists of m unitary, 
Mutually orthogonal vectors a, = (а, Aj» «++ 44) i = 1, 2, - т. Thus 
aX, + aX, +... + а„Х„ 20,i212,..m. (2) 
м Us transform the variates X, to Y; 1 €i € n by means of linear orthogonal 
Y = AX, where A = [a] isn x n orthogonal matrix. In this system of n 
“uations, y. y... y, are each zero by (2). Hence 


‚+ es, 


Е P ix -Yx EY? 
TE i=l і=1 {=т+1 


^ 49 
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By Fisher’s Lemma, Y; 1m. 95... "1 Ore i.i.d. МО, 1) variates, hence the distribution 
lon o 


rx; subject to constraints (1) is the same as the distribution of У, +, +. у 
А " А 2 n5 

by (3), which 15 obviously X(-m: 

Example : Let Х|, X», => X, be i.i.d. NO, o?) variates and 


Y, = a, X, t a5 X; +--+ à; slut aa! 


where Ха; а = 5, (j= 1,2,...,п); ё being Kroneker delta. Show that 
[X tot X) - 02 +... Ya? ~ Xo-mr 
Solution. Since 8, =0, ifi#k and ё, =1, if i = k, it follows that the matrix А = [a] is 
orthogonal and hence Y = AX is linear orthogonal mapping. Consequently. 
Re Ree Xe m FY etl 
So [(X2 + X2. X1) @ Y? Y.) = yu ete eens AA 


By Fisher’s Lemma Y; ~ N(O, o°) are independent variates, hence (Y/o) ~ N(0, 1). 
Consequently 


ens + i Yo. Ыйы [Sum of (n – т) i.i.d. X^ variates]. 


21-74. Distn. of Sample Corr. Coeff. when Population Corr. Coeff. is Zero 
Theorem. The p.d.f. of the sample correlation coefficient r in a random sample of 
size n from an uncorrelated BVN population is given by 


ТОШЕП ил йс у 7", -1srsl 


Proof. (Sawkin’s method). Let (X,, Y), (Xz, Ү,),..., (X,, Y,) be a random sample of size 
n drawn from uncorrelated BVN population with specifications. 


E(X) = E(Y)=0, Var (X) 2 c^, Var(Y) 2 o", p- 0. 


We transform the random vector Y to the random vector Z by means of a linear orthogon 
transformation, viz. Z = CY, where C is an orthogonal matrix. Explicitly this means : 


al 


Z = С.ү + СҮ, 0 Pisis Сый, Zi C, "m C, Y, 

Z,- CY + Coh t ч Zaia |C + Ca ү, 

жеб * Cof, Cu, Ex Tone С LY 
Let us choose С = Cy = = Cin = 1/Jn, whence Z, is given by 


Z,- («Y tath aT vn => Zp п". 


Also, EZ? = ZY?-I(,-Y)«Y] «XQ, Y) «nY*, (si л) since cape F=. 
й y. d 5 
Letting У(Х, - Xy! =nS;, ZY, - Yy =п52, the preceding equation can be express 
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`7 ^ 2 ; 
L2 е n5, [=2 3, ‚п (i) 
wre 20,-3)0-Y) XX -X)Y-YXX -X) xx - Х)ү | 
NO ns, S; n Si S, n S, 5, ( [ ef ) | РАР ( X, X ) 0] 


if we choose Cy = (X, - X)/8, Уп, the above result gives 
„= УС, Ү = У(Х, - X)Y./ S dn = rS,Jn => 22 =п52,? (її) 
Eliminating R between (i) and (ii) we get 
EZ. = n(1-r^)S2, k=3,4,. A) 


By Fisher's ema, Z; ~ МОО, o' "BIAIS n, are independent and so Z/o' ~ N(O, 1) = 


gijo E^ E. Dividing (ii) and (iii) by o"? , and using Reproductive property of 


y"-variates. 


U = (n$7r 10) - 2; ; Ve n0 - 2) S110" ~ X; 


P= КАШУ ~B, [4,4 (n - 2)]. [8 21-61] 


It follows that the elemental p.d.f. of 7? is 
dP(r) = [B[1,1(n-2) (?) (1 - гун" 9?-! der”), Or? «1 
i.e. dP(r) = (B[1,1(n-2)]]' (1-r el dr, -1<r<l, 


the factor 2 disappearing in converting the range 0 < r<ito-lsrs<l. 
Example : For a random sample of size 5 from an uncorrelated BVN population, if 
P{ Irl >k} =a, show that k is a root of the Eq. 
kj1—k? sin (К) -31(1-a) 20 
Solution. The p.d.f. of “r” from a BNV distribution (p = 0) is 


f(n = {Bit tn- 0-7)" dr, -1<г<1. (i) 
When n = 5, B [1/2, 3/2] = Г(1/2) Г(3/2)/Г(2)=1т „4 
а = P(Iri2k)z1- P(Iri«k)2 1- P(-k«r«k) 21-2P(0 x r К}. .. (iii) 


Because f(r) is symmetric about r = 0. From (i), (ii) and (iti) we get 


1 2 fk 1 * k 
501-9) = р(0<ғ<)= = |, (1-72)? а= — [ra - 7) + sin €], 
" ix-a)- КП +sin"(k) > ЮЙ -К sin" (k)- 40 (1-0) =0. 


21-80, Pearson’s Chi-square Statistic 


I (n, = np, 
^ à large sample : 3 ion A 
#4 a HP 


А С е)? 
A E " [Populari written : T4. -- Кач ) 
бш, y is the observed frequency and np, is the expected frequency of the jth class, 


im] €; 
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Proof. Consider a random sample of size n. The members of this sample are distributeg 

at random in k classes Сү, C3, ..., C,. Let р; = {а sample тол e Ci}. 

If n, is the frequency of C, then these frequencies shall possess multinomial frequency 
j ) 


ni n, 


function fin,, n, ..., т) =f, say ; where f= [n/n,!n,!...n,) p, б A Dy 
. "94 as . = < < 
Неге, Уп, =п; Èp; ШЕ ГЕК. 


If the sample size is sufficiently large, n; are large too and hence the Stirling’s 
approximation for each of these factorials is valid. Then 


-n ,n41/2 n n hy 
y» (v2n)e n Di Рә =» Pk 
s k —(N tM tatn ) d +4 n qut n +t 
Gian), е  * SMe Sse ANNE А, 
1 2 k 
an 


т +2 n, +4 7 n+l 
ы (np, / nj) (np, т) -AT (22) (1) 

(2n)! (p, p, ... p) nt? SA 3 
where А”! =(2nn)“~!"(p, p, ... p,) 2. We notice that A is independent of n;'s and for 


a given n and for a given set of theoretical probabilities р, A is constant. Further 
notice that E(n;) = np;. To simplify (1), we introduce 


n —np, п— ө? 
= LI. (0, =./пр,). mp. 
i б, (Ө, = ү/лр,) (2) 
This gives : n; = (07 +6,z,), and substituting for n; into (1) we get 


Amit i "hy (өз 1) а 
„(2 "2 n +5 lo У 0+0, +5 бп EM 


і= 1 i i=l 


i 


Assuming that (z/0;) < 1, we expand the logarithm to get 


ng =- (ets EET SCIES кё +о@г у) 20) 
neglecting, of course, higher powers of (2; /0,) if z; << 0.. Now 
Ez0, = X(n – пр) = Xn, -пЎр, =п-п= 0. (4) 
For large n, O(07')— 0; so Eq. (3) provides 
ЖОРГА) > -i£Zz, іе. f-Aexp[-(22)/2] bere E) 


By hypothesis of multinomial frequency function, 2; are independent variates and 
form (5) suggests that each Z; is N(0, 1), since A can be chosen so that h df =1. In fact 
А = Qn)". 

It follows that he must be a Xo -p Variate, one degree of freedom having been lost 
by the linear constraint £z,6,=0, by (4). 


LL „наанаа 

* Out objective is to find the probability that the random quantity x? will exceed an arbitrary assigned numbe \ 
(say). As such the distribution of y^ is the total probability of all points inside the hypersphere ae 
Consequently, we assume (5) as the continuous distribution and hence evaluate A by integration. 
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90 The Non-central pce Distribution 
81-7". — | 
pefinition. Let X; ~ N(u;, 6; *), 1s > п be independent variates. The rv. Y (LX; / 07) 
[4 


ET. de ad | 2 a _ ¥,,2 ) 
is called non-central Xin) > denoted Y А (л, А) where 2A = 2 / o; 
1 


Т, determine the p.d.f. of non-central X^ 
0 


step 1. Let X ~ N(p, o^). Then m.g.f. of V = X^ |o? is [Example 16-30] 
[4 * 


Myla) = 0-20 P expAor/0-20)- (0-20 ^ e% exp [àg 70-20]. [A = 12/207] 
Step 2. We now determine to m.g.f. of Y = У(Х? / o2) and its p.d.f. 
и, 
КА п Ф м А п -Ai А, ln. = | 
M(t: Р = i - (sano Пе ехр 1 27) с: 


= (1-21) "е exp [A/ (1- 27] = (1-21)? exp [24/ (1 24)]. [2A = E(u? /07)] 
where A is called non-centrality parameter. Some authors write с = 2A. 
Density. We use Inversion to Ch. Function for finding p.d.f. Thus 


r=0 r! г= 0 


т LAU WM ren2) _ oiy 00m. 
= 0-22)" 2. — | тыгына онунон р гу; 


where p, = e^X /r!. 


| J er poe ion Formula, 
f(y) = d by (eat = 2 P, lie " (1 — 2ir) dy}. [Inversio 
T r= 


-U2 ,(n2*r)-l xr 2r 2 
PD CM ‚ $.(0 = (0 -2it) 
Recall : Z ~ Xi, fz(2) = Tin 27/2] 2* 7 $, (0 
Wi? onis а £e? ni2+r-1 
is —-y/2 .nl2+r-1 ET ү, ў M Ўр m A 
=e г Ar(n 
` f»- x Pra UID T(r + n/2) eet yi a Г [r +(n/2)] 


Cumultants and moments : eden а 
Ik Ir = K(t:Y) -ün M(t:Y) = (01 20) "e ^ exp A/(1- 

-I 
-(n/2)0n (1 20) - А+ А (1 20) 


- (" )5 ё Qo ved Qy 5X2 -DFA È. г “| 
55 2 


r=! 
r=0 


r=] 


wir 
^s ӯ 1)! (п + 2Ar)3k, 41 = {2r[n + 2(r + DA]/ (n+ 27А) } К, ( 
Using logarithmic differentiation w.r.t. A we get 
dk Jd. = rk / (n + 2А) 
[n  2(r + A] (dk, / dd) 


TU 


From (1) & (2) : k 


TS bag 


From а) : k, =пђ+ 2), ky = 2(п + 4А) = Уагіапсе. 
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H8 — M 
— - - 


Reproductive Property. If X, ^X^ (A, nj), i=1,2 are independent variates. then 


X,+X,~ X^ (A, + А,, n, + Ny). 
Proof. M(t: X,+X,) = M(t: X) M(t: X2) 
ds (1 e 74 Wd elo 2n ерү” ИИМИ? n 2 


1 r 
оң + Ny) 2(À, + 5.5) /(1— 21 
2 е 21) 


This proves the property as stated. 
Note. If X = 0, then M(t : Sy) = (1—2) ^*, so Ќи) is simply the % -density function 
with п degrees of freedom, whence A is called non-centrality parameter. A non-centra| 


m 


chi-square variate with parameters А and n is denoted by y^(A, п). 


21-91. Miscellaneous Worked-out Problems 
Example 1. If X is 9 show that for large n 
— (i) (X -n)/V2n ~ N(0,1), Gi). (2X – V2n) ~ №0, 1). 
Solution. Let Y = (X – п)/ 422п. 
M(t: Y)= MX/V2n- [1n 2 e"?! ма! 2n: X) €"? [1-201 J2n] "^ 


in M(t:Y) = —4n/2t- 1 nln[1 - 2t/ J2n] 


EEUU TI LP, 4T. (7). 
Xia gH. 2 (J2n)° X 2.3 x Vn 
As n — ©, фп M(r:Y)o 11°. Since logarithm is a continuous function this provides 


lim M(t:Y) = Ral — Y ~ N(0, 1) for large n. 
Gi) РХ -vV2n <k} = P(2X <k + vV2n}= POX <k? + 2л + 2kV2n} 


= PIE chs steels 


Since У > N(0, 1) as n — o, J2X – J2n — N(0,1) as n is large. 


Example 2. Let X ~ 2, and define U = (X - n)/J2n. Using C.L.T. show tha 
limiting distributions of U is N(0, 1). 


P{Y < k}, for large n. 

t the 
1 i a у? i.i iates. Then 

Solution. (i) Let X = X, * X, +... + X,, where Xu Ха) аге i.i.d. varia 


E(X) 
U 


пЕ(Х,) = п; Var(X) =n Var (X,) = 2n. So 
gt aS TE) X-n 
ae SENE дн 


(by CLT) 


— N(0,l)asn-» oo. 


De ——————— Exercises 6 3 5 


1*. 
2*. 


3*. 


-— 
— 
+ 


t2. 


13, 


AA 


] po -y З 
· Prove that P{X72n +2) »23)- |, e? y"dy= Y 
s r=0 


Problems with Solutions Provided at the End of the Text 


Give a reasonable definition of X, -variate with zero degrees of freedom. 

Let Y = бп X, where X ~ x7... Show that M(t : Y) = 2'T(4n+t)/T(in). If X, and X, 

are 1.1.0. Xi, -Variates and F - X,/X,, deduce that for a positive integer k, 
E(F) = FGn« к) Г (п К) (ГО). 

If Х|, X», ...‚ X, is a random sample from N(u, o^), find the mean and variance of F. 


Exercises 


. IfX,, X» X, is a random sample from N(0, o°) population, find P[ZX? € 3o? ). 


2 
. I£ X, МК, К), k= 1, 2, 3 are indep., construct a dns variate using only Х|, X», Хз. 


. Let X and Y denote the number of successes and failures respectively in n independent Bernoulli 


trials with success probability p. Show that 


[(X — npYInp] + ((Y — nq)'/nq] 
can be approximated by Y: for large n. 


. Give an example of two independent variates none of which is a X -variate, although their 


А 2. : 
sum 1S à X -variate. 


а). If S? is the sample variance of a random sample of size 6 from the М(и, 12), find 


Р{23<5,<22.2\. 
(b) For arandom sample of size 25 from N(3, 10°) population, find 


P(0<X<6, 552<5° <145.6}. 


. IfX,~ N(O, 1), i= 1, 2 are i.i.d. and Z; ~ N(1, 1), j= 1, 2 are i.i.d. variates, find the p.d.f. of 


LEG 7 X &(Z, 7 By + (Z + Zp). 


- A point (X, Y, Z) is chosen at random in 3-dim space where X, Y, Z are i.i.d. №0, 1) variates. Find 


the prob. that the distance from the origin to the point will be < 1 unit. 


- If X ~ Pois (A) and Y - aes show that for all positive integers n 


PIX <п-1} = P{Y 22}. 


-À г 


"E where y= + х. Explain the uses 
of this result. 

It x ~x, show that 1 — P(X € x) < nlx. 

IfX,,X,,..., X, are i.i.d. Expo (À) variates, show that 2A УХ, ~ dus 

If X -X2.. find the p.d.f. of Y= X/(1 X). 


It X, X, ..., X, are independent variates with continuous c.d.f. F,, Ё, «., F, Show that 


—2Un [F, (X5) F (€) ... F, OG] ~ +099 
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14. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


Let fix, n) and F(x, n) denote the p.d.f. and the c.d.f. of Xin) variate respectively and (x ) be 


c.d.f. of N(O, 1) variate. Show that 
(a) afix, n) = nf(x ; n + 2). (b) fix, 2n) = 1/2, (п = l, ... ©). 


(с) Fix, n) - Е(х;л+2) = (1 х)" Ее, /Г(уп +1). 


(d) ®/(х,2л+1)=Ф(/2х)-1/2, х>0. 


. If X - Pois (A) and 2aA ~ TAA obtain the unconditional distribution of X. Give the name of 


this distribution and find its mean. 

Let X, Y, Z be y -variates with 2a, 2b, 2c, d.f. respectively. 

(i) Show that X/(X + Y) is independently distributed of (X + Y)(X + Y + Z). 

(ii) Obtain the joint p.d.f. of the distribution of U = X/(X + Y + Z) and У = X/(X + Y + 2). 
Name the distribution and find Corr (U, V). 


If X and Y are i.i.d. Xo -Variates, show that p.d.f. of Z= + (X —Y)is 
fg = le", -e«z«o. 
Let X ~ МО, 1) and Y ~ Ху be independent. Show that 
(aX + bYY 1 (à? b) - xo, (a#0, bx 0). 
If X ~ N(0, 1) and Y~ x4, are independent, show that W= XY' is distributed like the sum of 
n indep. variates W, with p.d.f. 
fw) = iexp(-Iw;D), —-o«w;«o. 
Let X,, X,, ..., X, be 1.1.9. №0, 1) variates. If X = Уа; X, and Y= n? (i= 1,2, ..., n), show that the 


conditional distribution of Y given that X = 0 is X7, j, distribution. 


Let y dx be the probability that X lies between x and x dx, and y be given by the solution of 
differential equation (dy/dx) = y(a — x)/(bx + c). 
With suitable values of the constants a, b, c show that certain linear function of X has the 


X distribution where n = 2[1 + (a/ b) + (c/ b^)]. 
Find the limiting distribution of n? x7. 


If X ~ Xm» show that /2X ~ N (J/(2n – 1) , 1) for large n. 


. If X ~ Ву(п, А) where n is an integer, show that for large n and small A, a first approximation 


gives —2A (п X as NA -distribution. Show further that as an improved approximation: 


—(25. + n - 1) Un X is Xon -distributed. 


, X, be i.i.d. : 
Xi Xo -= X, be i.i.d. 7, -variates. Define Fe XIX, Y a XJX, ..., Y, ,- XJX,. Find the 
p.d.f. of Y, У... A 


D | E Ww X, bea а sample from bin (1, р), O «p « I. 


nd th : p.d. f. of the sample variance $2. 
л) fap en X, be a random sample from Pois (A). Find Var (X) and Var (52). 
La ^ X, be a random sample from Му, o°). Find Var (S "x 
‚ X, be a random sample from N(0, 1). Define 


ае К E A M 
(n— rp "m 


‚ of (a) AX? + (п К) X! ,. (Б) (k- D 52+ (n-k- D $2 
mee Y,, ¥,, ..., Y, be indep. random samples from N(0, o?) она their 


| = У ae SrH ÈA- Xs, P= 


/ and variances e = respectively. Let the pooled variance S be defined 


$3 +n- -n$3)/(m«n- 2). Prove that 


m+ tm), and ae Fa зай 7 Xim+n—2) , and that they are indep. 
on [f] redu Emme of freedom of 


The secret of creativity is knowing how to hide your sources. 


(Albert Einstein) 


Fisher-Student t-Distribution. 


Snedecor-Fisher F-Distribution 


Introduction. Їп this chapter, we consider the basic concepts of two outstanding 
sampling distributions called t-distribution and F-distribution which are related to Normal 


and Ch-square distributions. The wide variety of applications of these distributions 
may be considered later on. 


FISHER-STUDENT t-DISTRIBUTION 
22-10. Definition 


A random variable T is said to possess r-distribution with n degrees of freedom, if its 
p.d.f. is given by 


| 2 -(n41)/2 
fit) = Жир э ARLI KD 


Variate T having p.d.f. (1) is briefly written, T ~ t} See $ 22-32 for sketch of t3) 
and t7) 


22-11. Fisher’s t-Density 
Let X ~ N(0, 1) and Y s be independent variates. Then, the variate Т defined by 


[Fisher's t-statistic] 11 


has (Fisher’s) t-distribution with n degrees of freedom, | 
Proof. Since X and Y are independent, their joint elemental p.d.f. is 


-xn -y/2 prta 
Pa AM ORI PETRO 
dP (x, y) = fix) dx f,(y) dy = Jon TEn). D" © PENE y 
Put y = s, t= x/(y/n)", ТРОЕ у=; [s>0, Itl<o] 


i/24ns (s/n) 
1 0 


Ox/Os Ox[Ot 
ду/дѕ ду/ді 


O(x, у) _ 
O(s, t) 


18, 


FAL. 


640 Fisher-Student t-Distribution 
The Joint p.d.f. in terms of s and ¢ is thus given by 
(GU 120) Is In - 1 2 5 
е ——— ы is dt = ~ 

ex J2n Г(п/2) (2)" 


To obtain the individual p.d.f. of T, we integrate out unwanted s to obtain 


| I 4 
(п 1) = 1 JESUM 
e ds dt 


Jon T (n/ 2) 2)? 


sein] dinette 1 
dP(t)= qr | татты eat [Use working gamma integral] 
0 (2n)? T (1n) (2)"? 
Fl * 014 T0] 1 dt E 
с n+1)/2 pur mes n) iit. [1 ali (t^ ГҮ) үм 1)/2 ? á 


HOEY ^ Qni)" r (0) 0)" 
Thus, the p.d.f. of T is given by 


ҒО) = [Уп Bandy [Ie à /np "* ^; оо г< оо. (2) 
22-12. William Gosset's Student Law 
If Х|, X», ..., X, is a random sample from N(p, o?) population, then 
T= [(Х- u) Jnl 51 ta-n- [Student's t-statistic] LD 


P y= (2B) is мо, PNIS ENSE Y and Z are independent; h 
roof. Y= nid. is m, Diz- & Kaha Y an are independent; hence 


T= Y/[Z/(i-0]? = (X - p)/(S/ Jn) 
Thus, ¢ is 10, |, distributed [by $ 22-11 above] 
Aliter. We rewrite (1) as 


«ite - [90 29 ps a 
n-l (c^ /n) " гї tee a 


_ (К? 2 (X. a | 
Now Y = pw А 15 N(0, 1), hence Y = рге Хор: Also, (nS* 1 o^ )is xn. 


Further X and S^ are independent distributed [$ 21-70], it follows that the above 


Т?/(п — 1) is the ratio of two independent, dn and Yn variates, and as such Tn- 1) 


is By [G, 2 (0 – 1)] -variate [§ 21-60]. Consequently, its probability law is given by 


p yEy y Nam-i i 
IBG, (n - DT eig M ul. | 
1 n-li n-i 


1 ] gv 2 -n/2 
= t ETS ai (2) 
B[i.! 2 (n – D] (n – ap? | -1 | 


dF(t) 


$22-20. Non-existence of m.g.f. 2 y 64 1 


We have dropped the factor 2 and taken the range —o < t < œ, since F(%) = wt F (—со) = 0. 


Cor. For one-degree of freedom [n = 1] in definition or n = 2 in (2)] 
fit) = (BG, D]'(1-y's1/n 407), -o<t<om, 
It follows that /,,, is a standard Cauchy-variate. 
Remarks. Fisher's T-statistic is defined by Eq. 22-11(1) and Student's T-statistic is 
defined by Eq. 22-12(1). They have the same p.d.f. except that for Fisher's 


t-distribution, d.f. is n and for Student's t-distribution, d.f. is (n — 1). We may note that 
Student's t-distribution may be regarded as a special case of Fisher's r-distribution. 


Example : Let X, Y, Z, W be i.i.d. №0, o?) variates and define T= k(X + Y)/ JZ? + W?. 
For what value of k, T ~ Lay Find n as well. 


Solution. (X + Y) ~ №0, 20°), hence U = (X + Y)/ 426 is NO, 1). V = (Z? + W?)/6? ~ 2. 


_(X+¥)V25__ NOD _, 
KZ wh fy2,/n C 


On comparison with Т, we find k = 1, n = 2. And T ~ to) 


T, = 


22-13. Relation of T with Normal Distribution 


As n — oo, tiny > N(O, 1). 


Proof. f(x) = К+ G^ /0] "7, k= Vn BCA, En) (1) 
; Seb te 1 
imk = tin = =— Es 
emo msdn TOT m Jan Ed 
2 -(n41)/2 ; a bnc 
ЕСИ E 


Taking limits in (1), using the limiting results (2) and (3) we obtain 
lim fix) = (V2n)' exp(? /2, -0< x< 0. 
Hence for large n, t,,, > №, 1). 
Remark. The t-family ranges from the heavy-tailed Cauchy distribution to the Normal 
distribution. [See Fig. 8 22-32.] 


22-20. Non-existence of m.g.f. 
If X ~ tn» (п> 1) it can be shown that E( | XI") < %, for r < n and E(1X |°) = o, for r >л. 
This means, the first (n — 1) moments of X exist but moments of order r > п do not 


exist. Consequently, the m.g.f. of X does not exist. 
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22-21. Moments of t-distribution 
If X is МО, 1) and Y is X2. X and Y independent, then T = X + (Y/n) ^ = n^ XY)? ~ " 


^ Er’) = п? E(X')E( ^). 
Since X is symmetric about zero, its odd moments are zero; hence only even moments 
of T are non-zero. So (г — 2r) 

E(T")-m(EQX")EQ")-n E(Z')EQ7) — IZ- X - xi) (4) 


If W ~ Xim» thenE(W^) = 2^T (En + )/T (1n) 22! (10). [§ 21-20] 


EY’) = 2'rn-r/T(n;E(Z)-2'G «r/YQ). 
Substituting into (i) we recover 
aTe N+) nO  ,1.53.5..0r-3) 2r - ) 


у > сыс re "wi 


han TOT T TOGS a=" (-30-3).-2) 


Aliter. f(x) = ЦІ + G7 /2] "+"? ;— «x «o, [k = VnB (їп, 1)] 


Since X is symmetric about zero, all its odd moments are zero ; in particular E(X) - 0. 
Thus, the simple and central moments are identical. Now, 


бу so iren In] ^"? д. 
Let х? [n zz then dx = 1 (nz!) dz; "cx «o => «z-o, 


Qe Уп dz 


2Jz’ 


2 оо 
A Meu С fd 
hs Bun D b 09 0+ 


(r*1)-1 а-1 
n’ o Z 1 dz © x dx 
= ==, =a = В(а, Ь 
B(in, 1) à (14.2) ^ * )? Г (1+. х)“* (а ) 
= n' В(г++,3п – r)/B(in, DznTGn-r)E(r +AT). (1) 
= (n) К H /n E ky. [al = а(а+ 1) latt 1)] х) 


22-22. Moment Recurrence Formula and Pearson’s Coefficients 
Replacing r by (r — 1) in 22-21 (1) we get 

Hoyo = aT Gn-r +P (r-D/Tnr() 
Dividing the result of р, by that of 5, , we get 


[nQr — 1)/ (n - 2r)] py, 2. Zu 


Н, 
H =n/(n-2), (п> 2) 


In particular : — Var (T) 


К __$#22-31. Mean Absolute Deviation from Mean 643 
Since u = 0, the САЙ сет of variation for T does not exist. 
Since ц; =0, so p, =0, Y, = 0. Also AE Зп? / (n 2) (n - 4), (п> 4) 
So B, = 3n - 2)/(n- 4), y, 2 6/(n—4). 
Obviously, (В|, B5) lies on the St. line : В, + В, = 3(n - 2)/(n - 4). 
Note. lim B,. =. lim 31—-(2/п)] _ 
n>% n>» [1—(4/n)] 
This shows that 1,,, tends to Normal distribution as n — ©. In practice when n is large, 
say n > 30. t is approximated by N(O, 1). 
22-30. Mode and Points of Inflexion 
Here v = f(x) =k [1 zt (x. ny hs pz = n^ B(.n, 1)], И I ee? 
We take logarithm of both sides and then differentiate 
(n y = ink 1 (п + Dn[I GC / n] 
yy s -(n* 1) x/ (nt х2); (у” / y) - (y! yy = (л + D(n-x)/ (п + in” yt 
For max-min of y, y' = 0 and 1(а) provides x = 0. From 1(b) 
у"(0) = -[k.(n* D/n]«O. 


Hence the modal value of f,,)-variate is at x = 0. 
For determining points of inflexion, we put y" = 0 and eliminate (у'/у) from 1(а) and 1(b). 


Thus, 


(+10) х (n+ 1) (n — агаа п | п |. 
(nx) (nt x^) n+2 (n+ 2) 


| | | , Л E к / А "TWO (n + 1)/2 
So, the points of inflexion are given by 225-21 lect 


Remark. As n — ©, these points tend to [+ 1, (2e) 7] which are the points of inflexion 


for N(0, 1). 

22.31. Mean Absolute Deviation from Mean 

Here : f(x) = кра Осо / mp "^, [ke m Bn 5), 9 <х «o 0 
Since f is symmetric about x = 0, [f(—) = Дх ; E(X) = 0. Now 


Ixldx 2k [P x dx 
[1 +(x 2 mm 0 [i +(x? Ir рр 
To evaluate it, ме put хп = z; then 2x dx = n dz and so 


val + D] 2. nr D) 
r@)rdn) n-l аг) — 


MsE(X-00)sk[., 


M = nk i dz ға E E [Putting for k] 


(1 Ре ae 1)/2 
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22-32. Shape of t-density Curve 
Дх = k{l+(x? гп) ^*^. о сх < оо 


(1) The curve is symmetrical about х = 0, f(-x) = f(x)]. 

2) Asx — + o, f(x) > 0; thus x-axis in an asymptote to the curve y = f(x). 

(3) p, = n/(n — 2), В, = 3(n — 2)/(n - 4). 

For n > 2, р, > 1, i.e. Var (X) > Var (N(0, 1))} ; for n > 4, B, > 3 > t, curve is flatter on 
the top than the N(0, 1)-curve. As n — ©, t,-curve coincides with the Normal curve. 
(4) The points of inflexion are : {+ [n/(n + 2)] ^, k [(n  2)/(n + 3)]" * ^) and mode 
occurs at x = 0, at a height k above origin. A rough trace is shown above. 


22-33. Probability Tables for.t-distribution 

Student (William Gosset) prepared tables for Р; = P{t < tọ} for different values of t, and 
different d.f. (n = 1, 2, ...). Fisher and Yates prepared Р. = P{| t | > tọ} for different 
value of г, and different d.f. (n = 1, 2, ...). The relation between Р, and Pp, using 
symmetry of r-distribution is 


Р; = P(tXt)- Р{-о <1<1} = 0.5 + P(0«txt,) ...(1) 
P, = P{itl>t)}=1- P{ltl<m}=1-2P{0<t<t} ...(2) 
2Po+P, =2 > P,=2(1- Ps). HE 


The Appendix gives the values of ¢ for different d.f.’s. These are used in the problems 
of Statistical Inference. 


22-34. Worked-out Problems 
Example 1. Show that the mean value of the positive square root of a Beta variate of 
the second kind with parameters 0 and m is L'(I- 2) '(m— 1)/ F (I) T(m). 


Hence show that the mean value of | ¢ | for v degrees of freedom is 


Vv F [1 (v - DV vn T G v). 
Solution. If X ~ By(0, m), then its probability density f(x) is 


1 
X 


Дх) = Bi та х)" x20, 1, т> 0 


ee 8132-34. Worked-out Problems 645 


1/2 


Ру" n. а (1+ 1/2) = 1 
E(/X) = E —— BE yd Зар? d P \ dx 
B(l,m) (1+ xy*"  B(l,m) ? (|+ xy!*2*-v2 
„Втр Te hemp 
B(l, m) T ГО. ГОт) > 
We recall that (12 /у) ~ Bu(j, iv); hence putting (vX)? =Irl,l=4, m- v/2 we get 


enn = Vv E(/X) = Jv (DT (v - /2]/ T) F Ev= WT Ev- D]/ Vn T (v/ 2). 
Example 2. Let the random variables X and Y be independent and follow Xi» 


distribution. Show that U = Jn (X -Y)/24XY,V = X «Y are independent and recognise 
their distribution. 


2 
Solution. Let u — Уп (x — »)/24 xy, v=x+y. To ease evaluations, put x = r cos 0, 


y =r sin? Ө so that | J | 


2r sin Ө cos Ө. Thus, u= Vn (cos? Ө — sin? 0)/2sin Ө cos 8 


= Jn cot 20, v =r. Now 


dF(x, у) = f, (x) БО) dx dy = (xy) be 8? dx dy/2"T*(n/ 2) 
E 2T (n) (2 5іп Ө cos0)"^! "| 
Tg Е РРА ДО аа =—_ 
м9 | r [r2 2 


Setting cot 20 = u/ Jn, i.e.sin 20 = [1 +u? In] ^,d0 = QJny ! (+u? /n) du 


узре 239 M. reru (i. Bes A 
qu eae T?(n/2) Уп n ха! } 


This shows that U and У (=R) аге independent distributed. Obviously, V ~ "9 which 
we otherwise known as well (Reproductive Property). To find nature of U, we use 
Legendre. Duplication formula : 


Jn F(n) 22^! Г(п/2) [(n+ 0/2]. 
о" p ein/T()T(/2)72"* BG, їп). 


T(/ Y? (n/2) 


fv (u) 
Thus, U ~ tm: Note that 


[1 + (и2 1 пу * Nn BG, tn), -0 <u <0. 


y ua He oon e Ji E - (Е, 27143. 


646 Fisher-S tudent t-Distribution 


" Problems with Solutions Provided at the End of the Text 


]*. Express the constants С, a, m of the following distribution in terms of its с and (} 


dF(x) = C(1- Ge /а?)]" dx, -a«x«a. (1) 
Show that if X is related to a variable / by the equation x = а!/(2т + 2 4 ry" (2) 
then ¢ has Student’s distribution with (2m + 2) degrees of freedom. Use th, 
Distribution to calculate the probability that /, 2 2, when л ч 2, 4 
2*. Let X,, X, ..., X, be independent observations from N(p, 6^) population and let 
X be the sample mean. If X' is one more observation independent of the previo; 
ones, show that 


; 1/2 ; 1/2 
аен оа) Е 


So n4] S n+ 


where S = E(X- XY = (п-1)$?. 


3%... 1f. às uos find E(X“). Deduce the moments expression for Student's 1, and 


(n) 

sample variance S^. Hence evaluate Corr (X, T), where X is the mean of a sample 
; 2 

of size n from N(y, с) and T ~ tp- iy 


4*. If X ~ г, show that (n - 1) Un [D (02 / 0)] 7 Xi (approximately). 


e er [17 E) 
r +n) in 4n / 


Exercise 22(a) 


(л)? 


You may assume that, for large n : 


1. If X is 1,,,-distributed, find (a) P(X 22] (b) P(-J2 < X < 2). 
2. Show that for A Student's r-distribution with n d.f., the m.g.f. does not exist but the absolute 


moment v, = E(IXI' ) exists. Find an expression for V. 
3. Let X and $? be the usual sample mean and variance based on a sample of л independen! 

observations from N(p, o°) populations. Prove that 

Corr (X, Vn (X = p) $) = [h(n = I? F- DIT- 0. 
4. Let /. (a, b) represent the Incomplete Beta function defined by 
ре part gy вт 
(a, b) = Bap fo xt 0-5! de, a>0,b>0. 
Show that the distribution function FC) of Student's r-distribution is given by 
Кау= V, 31, (on, 4), where x = [1 + Q7/] '. 


Conclude that [14 (1? / n)]'' is В, (n, t). 


T mEmeeneg GA 


Э а ED н 


IS - .D. A i > > > . . ? „2 
5. If Sis the S.D. based on n independent observations from a Мү, 0^)-population, prove that, if 


^" Ф d 4102 
X ~ ty then V = C, [2n/(X /2n]'? X has asymptotically the N(O, 1) distribution where 
C,- E(S)/o. 


[Hint. For п moderately large, $ is approx. N(oC.. 62/2n). 


n’ 


6. Let X, Y be independent N(0, c^)-variates. Show that РХ +Y)?/(X -Yy ]«4) 7070. 


T vX, l < ^x 9 i i.i.d. N(0, 1)-variates. Determine a constant k such that the r.v. 
K(X,  X3)I0G. X4 X2)? has t-distribution. 
8. Let X, and X, be two independent N(p, o?))-variates. Obtain the distribution of 


Y= (X, 4 X, - 20)/ Ji X, X. 


9. If X, 1 S i € n is a random sample of size n from N(p, o?) distribution, show that 


U- (Х- p) n – 1) / У(Х, — X)? conforms to tn- yy Variate. If X is an additional 


observation from (и, o°), independent of X, show that 


у= (X - X) nin- 1/5, n+l ~ta- 


where b? is the sum of the squares of the deviations from X. 
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J SNEDECOR- FISHER F-DISTRIBUTION 


22-40. Definition 
A random variable X is said to possess F-distribution with m and n degrees of freedom. 
written X ~ F (m, n), if its p.d.f is given by 


im (т/2) -1 
fia) = oi — Les Z> 0: f(x) = 0, x «0. viel) 
B m, п) [1 - (mx / n)" *? 


F-Distribution 


22-41. Quotient of Two Independent Averaged Chi-squares 
If Y - 47,, and Z~yj,) are independent variates, then the variate 


Ү/т п Ү 
mota eat) 


E UB mZ 


if F (m, n)-distributed. 
Proof. Since Y and Z are indep. their joint elemental p.d.f. is 
| PEENE A. 2") -! 

ар, (у, 2) = ЛО) Р) dy dz- Tam ay" Tan. dy dz, 0 < y, z<™. 

We now put U = (nY/mZ), V = Z, and consider the transformations 
u=ny/lmz,v=z > у= (тп) иу, z-v 

Oy, 2) ду / ди Oy/ Ov} _ mv/n u/n 
Фи, v)|dz/du dz/av| | 0 1 
Thus, dy dz = (ту/п) du dv. Hence, the joint elemental p.d.f. of U & V is 


J-E 


n 


іт =4[1+(m/n)u]v | (m/2)-1 (n /2]-1 
u y du dv 
) а ,0«u, v«o. 


dP, (и, v) = (= 


9 (P rd m) T 1n) 


To get the individual p.d.f. of U we integrate out unwanted v to get 


1 з 
(m/ n)?" ue" "du yin e maet qd + mim, 


dP(u) = —1—— —— — 
ДУ ani werd 


§22-42. Quotient of Two Independent Sample-scaled Variances 649 
im 
Я) 
n 


lm I2) - 
(т/п)? u""?-! dy 


В(2т, 5 n) [1 + (mu/ ny" *"? " 


[7 [ : (m * n)] | uo | du 


1(т+п) 2 i m * n2 
(2)? Г(1 m)T(! n) ut + (mu! n)]] i 


[By § 0-11(a)] 


О<и<о. 


Thus, the p.d.f. of и, using dummy variable x, in place of dummy и, is given by 


/ іт (m/2) ~ 1 1 
CNRC E m NM 
B(x m, +n) [1 + (mx / n" *" 
Remark. § 22-41(1) may be treated as an alternate definition of F(m, n). 
Cor. 1. If X is F(m, n), then (1/X) is F(m, n). 


Cig x « 09, 


Proof. Let О ~Xim» V - x»; then 


Ulm 1 Y4A 
Ut Vin? ix Xm 

The latter is the definition of F(m, n) so x F(n, m, 

Cor 2. If X is „у then Х? is F(A, n). 

Proof. Let U - N(O, 1), V - ES then by definition 


2 
- M == Т? = =i = F (1, п) [because W = U^ ~ x5.] 


22-42. Quotient of Two Independent Sample-scaled Variances 


If X,, Xz ..., X, is a random sample from Му, ср) апа Y,, Y,, ..., Y, is another independent 
random sample from N(p,, o5), then 


($2157) ($2162) - Е(т-1,п- V. 
Proof. Recall : (v$? /6?) - x2, [8 21-71]. Hence by $ 22-41 (a) 
_ (uy frank) (v, 52/62 v). ($2101) 


© (lira) (v,$?/o1w,) (52/02) 
is Snedecors F(v,, v.) distributed. 


Remark. § 22-42 is extremely useful for testing hypothesis H,:0; = с3;. 


Example 1. Let Х|, Х,, be a random sample from N(0, 1) and Y,, Y, another random 
sample from a different distribution N(1, 1). Find the distributions of the following : 


(а) (X, - X,)/ 42 (b (X,+ X405 =) ( Qt Xo/ OG + X 


(d X «y | (e) (X, X! [Qt = X + (0, -Y/2 


(D t, y, 1 x, - X,y! e (X, XY 1/2 (B (Y, + Y, -22 /(Ү, - Y. 
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folstien. k Batic геній L inear combinations of indep. Normal variates is an appropria 

Normal variate. 

(a) Let X = (X, ~ X,)/ V2,E (X) = 0, Var (X) 

(b) U=(X, +X,)/ 42 ~ NO, 1), V =(Х, =) 42 ~ NQ, 1); X, + X, and X, 

So X'. = Qür X U^ _Х® pq py 
(X,-X) V Xm 


=l (Var X, + Var X,) l, so X ~ N(0, 1) 


X, are independent 


(c) Y s X tX, _ (X, +X,)/ V2 Ec. 
NL TX 1 721 V! 


U ~ N(O, 1), and V ~ N(0, 1) are independent. Hence X ~ Chy (1, 0) : standard Cauchy 


say. 


(d) X - Мр, 6? / n), so in the present case X ~ N(0,1/2), Y - N(1,1/2), hence by linear 


combination : 
X «Y ~ МІ, 1). 


(e) (X, + X,)~ N(0,2), (X, — Ху) ~ №0, 2), (Y - Y.) ~ N(0, 2), (Y, + У) ~ N(2, 2). 


Lxx OE AO EAS Ar 
U = y 2 ~ N(0,1); | s че ] “Ж; [U, V are indep.] 
X, 4 X, 6 IU. =, 00,1) — 


eee me ta Gee у toy 
JG - X) ау, - Ya ee ЙАШ 


Y, — Y, І X,- X, 1 X, X, } "РФР \ 
(f) W= Y; 4 Б + B = sum of three [N(0, 1)]^ variates ; W ~ y... 


(в) (Y, +Y, – 2)/ 42 ~ №0, 1); hence 


+Y- IQ Y, – 2)/ 42] 
Y, -Yy [(Ү, -Y,)/ 42] 
Example 2. Let X p Xo =» X, be a random sample from N(p, o°). Define 


= ratio of two Indep. 47,; hence W ~ F(1, 1) 


= _ 1 a ul 1 п >| Р 
X, = k ÈX рге? X;, dart" X, 
TERMS C E us. po - ST ee 
$, "odit d ( / 4) a nak ™ nokel Л Aim 4 a. S^z EU 
* T4 1 


Now find the distributions of the following : 
(a) o^ [(k - 1) 52+ (n- k- 1) $2 ,] (b) +(X; + X,_,) (c) (у-н) / 0 


0D 218°, (e) (X - 10 Jn! S. 


LL LLL _ 822-50. Moments of F-distribution 651 


‘on. ЖК / ony 2 
Solution (a) ( ) x76 Хик». (n-k 1) 5; 616° ~ у? T [8 21-70] 


By Reproductive property of Indep. X -уагіа(еѕ, we conclude that their sum is a Ж, 


-— 2 ‚ү ә 
(p X, ~ Na. o /&);Х,_,-М[ц,в? / (n - ку] 


2) variate. 


; Hence by Reproductive property 
X, + Xn- ~ NO. (0° /k) e c? / (n-k). 


Let Z= 1X, + X,_,); ThenE(Z) = y, 
Var (Z) = 1I(^ /k) + [c? / (n – ку]; whence Z ~ N[p, пс? / 4k(n — k)]. 
(c) Let Z = [(X; – 19/ oT =[NO,)P; soZ - х2. 


E ENS ok) kN) 
Sip (n-k-1)S?_,/(°(n-k-1) Y,/(n-k-1) 


(d) Y= БОЕ, п) 


2 2 
where Y, ~ X(- and Y, ~ л-р): 


ОЕ Qus. (-Ds75 5 v. , 
5 o/ Vn (n — 1) Jud USD ee 


where U ~ N(0, 1) ; V «x7, ., SO T is Student's t, 1) 


Exercise. Let X,, Х,, ..., X, be a random sample from N(0, 1) population. Define X , and 


X,_, as above (Example 2). Now assuming standard results, find the distribution of : 
(a) $C, € X, 1) (b Ki +(п- Ю Хор OX IX? (d) X,/ X,. 


22-50. Moments of F-distribution 
First Method. If X is F(m, n), then its p.d.f. is 


fo) = Kx"?2- pL (mx/ n) "P^, OS x «o, where К =(m/ ny" (Bim, тп)". 


ED S aD Sie y vy emm LIH 
E(X ) = Kj, [onm 7 Ln l iene 3 n 
а-1 
6 Bl B(im*r,jn-r) E uj Ads man] 
m В(іт, п) Lis 
n Eme n rino (n) Gm" (1) 
EX") = (4) гй ^m Grn 


| Second Method. If U ~ 12, and ыу" де independent, then 


zx X = (От) + (V/n)= (UI mV) ~ F (mn) 
ы 
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E(x") = (=) e(“]-() EWIE”) 


Now E(U') = YT (Im«r)/T(ám;E(V")22" F(n- r)/T (n) «[821-20(1) 


Making substitution into (2), the result (1) follows. 
22-51. Moment Recurrence Formula 


Write р’ = E(X'); replace r by r + 1 in §22-50 (1) to get 


OR GEES au амаа 
Br om Г(т/2уГ (n/2) 


Dividing this result by р’ we get 


ПМР) Н. тт+ 2р), 


а A on pry nln 2 2) а 


Mean and Variance. Putting r = 0, 1, the result (1) provides 


сота 2 —25- 
т(п – 2) (п — 4) 


ul = п bz n^ (m + 2) 
| angu PLS OAS- 4)' 


2(m * n —2) Im 
pd ; n» 4. 


Coeff. of variation. x = | 
22-52. Mode and Points of Inflexion 
If X is F(m, n) its p.d.f. is given by 
y=f(x)= Kx" (xa) "*"?. [a=n/ mand К^! = (т/ п)"? В( т, 1)], х > 0 
We take logarithms on both sides in (1) and then differentiate 
in y 
y'ly = (im-1) X5 = +(m+n)(x+a)', [у = dy/ dx] 


on K + (3m – 1) пх — 1(т+ n) Un (x 4 a). 


O") - (УУ) = 1(т+п)(х+ау? -Gm-D x7. 


m-2 m+n Am) n m2 y 
ti „7003-9 , arD m пъ". (say) 


Now y' 20 > 


Since 0 < x < œ, we must have m > 2. Putting for x + a from (4) into (3) we get 


y" е га т-– 2 E o 
y 2 [(т+п) х 2p 2x? (m+n) | 


Thus, the value of x given in (4) gives mode of F (m, n)-distribution. 


-2 
Modal value M = TY HER 1). [each factor < 1] 


n2 


x1) 


(4) 
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Inflexion. Now put y" = 0 in (3), and eliminate (y'/y) between (2) and (3) to get 
З= 3 nta] » ]|m-2 m+n 
Wim rl 7 ls Pw ^ 

ie. [(n* 2x -a(m-2)Y = 2[а2(т – 2) + 2a(m — 2) x - (n+ 2)x?] 

or (n+2)(n+ 4)x* - 2a (m — 2) (n - 4) x t a^ (m - 2) (m — 4) = 0. к А 


Observe that the sum and product of the two roots of this equation are 
X +X, = 2M > x,-M - M - x, = distance of inflexion points from mode М. 


Xj, = a^(m-— 2) (m — 4)/ (n * 2) (n+ 4). 


Since x), x; > 0, x, x, 2 0 => т> 4. It follows that inflexion points exist only if m > 4. 
We now shift the origin to the mode M i.e. put 


x = zt M -z« [a(m - 2)/ (n4 2)] me) 
Eq. (5) now reduces to 


(п + 2) (n+ 4)z? —2a*[(m+n)(m—2)/(n+2)] = 0 


z = tax [(m * n) (m — n)? .[(n+ 4) (n 2 ]? (7) 
This also shows that the points of inflexion are equidistant from mode M. 


22-60. Reciprocal Property 
Let X ~ F (m, n) and Y ~ F(n, m), then for all a 


(i) P(X >a} = P(Y € (1/а)} (ii) P{X <a} + P(Y x (1/а)} = 1. 
Proof. (i) This result is trivially true, since F (m, n) = 1/F (n, m) 
and [Х>а} i ае тлар 


For another proof ; we record the p.d.f. of F(m, n) as 
RO) = Kx! (n+ mx) de Kim aw Amba)... aO x ¥5-(1) 

Let x = 1/y, then dx = мут dy the range (0, ©), is mapped in the reverse (0, оо), hence 
absorbing the negative sign, the elemental p.d.f. of Y = 1/X is 

dP,(y) = Ky!) + gy) 0*2 ym e y-2dy = Ky (2n -1 (т + ny) " * "^ dy NU 
Result (2) is merely result (1) when m and л are interchanged. 
Hence, if X ~ F(m, n) then Y ~ F (n, m). Consequently, 

[Х>а] = (Y <a} which provides P(X > a} = (Y «a^]. 

(ii) By Negation-Rule, P(X > a) + P(X < a) = 1. Hence by (i), P(X < a) + P(Y sa") = 1. 
An €quivalent expression for (ii) is P(X 2 a)+P(Y2 a’) = |. 
22-61. Reciprocal Relation Between the Upper and Lower a-points 


If X is F(m, n), we denote that point by F,(m, n), in front of whose ordinate, lies a 
Proportional о of the tota! area of distribution. Thus P(X 2 F,(m, mls. 
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Points / (т, n) and Р, |, (m, n) are called the upper a-point and the lower с роци 
respectively. The precise relation between them 1s 
F, (n, т). F, (m,n) = , TT 


Proof. Vf X is F(m, n) and Y is F(n, т); then by def. Y = 1/Х 


F(m, n)-Curve 


0 Es | x 
P(X» F _„ (т. п)}= 1-а ze P(Y « MF, (т, n) = 1-а 

" P(Y » VF, (m, n)}= a. (By Negation-Rule) 
This means, area in front of [F, |, (т, n] is & and Y is F(n, m). 

Е, (n, m) 2M Б, (mn) => Е, (п, m). Fg (mn) = 1. 
Remarks. Let m = n. 
If о = 0.50, F, (m, m) = Q, hence 05 sk 
If a = 025, then О. О, = 1. If a = 0.10, then D, . D, = 1, and so оп. 
22-70. Relation of F(m, n) to Beta Distributions 
(i) If X ~ Ет, n), then Z = [1 + (тХ/л) ~ В, ($m, $n) 
(ii) If X ~ F(m, n), then mX/n ~ By (im in). 
Proof. Since X is F(m, n), its elemental p.d.f. is 

dP (x) = Kx 7! [1 + (nx / п) "1? dx, [К = (m/ ny" [B( m, зп), x 70. 


=| 
brat’ aja, хый М a TT MN 
Let e | "US. x nà! J dx = == 1 


Substitutions into (1) provide 


sou) 


(m/2)-1 20-1 u2)n = 1 

n ls z) UU +2 n dz m -z " (1 E z)' Р 
т g т z B(4m, +n) l 
I i tne 

We also observe that, when x = 0, z = 1; when x > ©, z = 0. Hence absorbing 


negative sign, the p.d.f. of Z, as given by (2) is 
1 
f(z) ы ўн: (= 2)" /B(L m, tn), 0«x« l. 
This shows that Z ^ B, (5m, 5n). 


(2) 
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— = 7 T "ensi — ——— —— — - "-—— 
е “/т P wt y: | 
«Y By definition, ^ = Ki ES us ML ad _ Ва (5, т) т n l 
(ii) РУ хіп n X gam (Ł,n) ELA" 4 1819-2200] 


22-11. Limiting Relation of F(m, n) to Chi-square Distribution 


Asn > 90, m F tends to be distributed as x? .. 
proof. The elemental p.d.f. for F variate is 
m/2 n/2 
m : = 72(n/2) - 1 
EET n dr ceo. 
B(5 т, 5n) (п+ mF yn +"? 


Setting mF = x, B(3m, >п)  F (3m) F (1n)/ I(im-«in) this becomes 


(1/2)n -1 убн e y a |! 
с, a | z) PAUUO “Ww 
D(57m)(2) ^ m D (jn) бен" = 
We now recall the standard limits 
bnc 
lim t +4) = е“ (Euler’s limit); lim i nd E 123 
n © n No N Г(№) 
In (2), we puta =x, р 2-5, с = -im N= зп, К = 1 т; taking limits in (1) as n — 9 
and utilize (2) with new values to get 
P(x) = x" 7! e^? dx Tam) (2)"", 0 & x « o. (3) 


This is obviously the p.d.f. for a y;,,-variate. 
Cor. If n — ©, and m = 1 then JF ~ №(0, 1). 
Since mF > тад it follows that JF > hey = N(0, 1). 


22-80. Fisher's Z-distribution 
Fisher's Z is defined by Z = in, Р, where F is Snedecor's F-statistic. The distribution 


of Z is given by the usual transformation law : 
M) =F) IFz | (Fee) 


" (m / ny» (e* rima 13.2 Ps Amn"? x — M те 49% 
В тіл) + (me? "UL В(% т, уп) [1 + (me we 
M2) is the p.d.f. of Fisher’s Z with m and n degrees of freedom. 


| Remark, The relation Z= +łn, F , implies that Z and F will bear the same Statistical applications. 
"e ai 


FP 
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22-81. Moment Generating Function of Z-distribution 
M(t Z) 4 E(e” ) le: E(e"?!^ F ) me E[e ^" ] = E( Fr? )= i 
Here u’, is the (#/2)th order simple moment of Snedecor F-statistic. 


m n Y^ Г (т + t). ГО (n - 0)] 
M(t: Z) =E(F )=(4)] Fiona. (1) 
22-82. Worked-out Problems 
Example 1. Show that F-distribution is highly positively skewed. Prove that if X is 
F(n, n) its median is at X = | and its quartiles О, and Q, satisfy the condition Q, Q, = |. 
Solution. Karl Pearson's coefficient of Skewness is given by 

$, = [(Mean - Mode)/S.D.] > 0 

because Mean = [n/(n — 2)] > 1 and Mode = [(n — 2)/(n + 2)] < 1. Hence F-distribution 
is highly positively skewed. 
When m = n, the elemental probability law of X is 


f(x)= Kx o»-1 / (1 +x)" ee © B(in,in), xao 
If Q, is the rth quartile, then its definition provides 


proja = EET aser ET 
Let x = 1/z, then dx = ra 22. =й, ж оу ооз х= О, => = 10, = q, say. Making 
substitutions into (1), we get 
NC 

% (I4 z), 


Using r = 2, Eqs. (1) and (2) give 


r ГА Г 
dz. 3 or o 70) 4=1- 2. 294, 


^ f(o)de = 5= |270) 


0 
This gives q, = О, or Q; =1 => Q,--l. Now put г = 1 into (1) and r = 3 into (2) to 8“ 
fe fonde = =f" fa) ах. 


This gives q4, =Q, > 0,0, = 1. 
Note. The solution follows trivially from Reciprocal Relations §22-61. X 
Example 2. Let X, ~ Ni, i), = 1, 2, З be independent variates. Using only X; Xy ^3 


give an example of a statistic that has the distribution (a) x2,, (b) F(1,2). (©) o» 
Solution. Observe Z, = [(X; — iyi] ~ МО, 1). Now 
(a) Z? + Zi + Zi = (Ху - 1) + [0Х, - 2/2Y +X - 3/3] = Y ~ x2,. 


Exercise 22(b) LLN 657 


(b) Zi - xi (Zz + Z0 - xi»: so Р(1,2у=— з #4 | XX – 1)" 
7 +Z,)/2 [£2(X,;-2)] «(i(X, -3)] 
N(0, 1) E РА /2(Х, 1) 


(с) Җә” T gutem ym er an — —— 
(1a/2 ^*^)? V [Boo - DP +h r^ 


E. 


2*. 


2", 


4*. 


‚ МХ Ет, n), show that W = (mX/ny[1 + (mX/n)] ~ B, (5 т, уп). Редис 


Problems with Solutions Provided at the End of the Text 


If the variate X is В (а, b) then the variate 7: 

ИИО РЕ имр (ү ау E ЭРИ 
(l-X)/b а1-Х) (l E 74 is distributed as F(2a, 2b). 

(i) If X ~ доу then Y ~ F(n-2,n-2) when X = 1(п – 2)? (1- Y)Y . 

(ii) If X is F(n, n), then Y ~ t,,, when Y= tyn [X'? - X 7] 

СИТЕ Лаб P{F(10, 12) > 2.753) = 0.05, Р ((1, 12) > 4.747} = 0.05. 


Find p, = P(F(12, 10) > 1/2.753), p, = P(-44744 < tan) < 44.741). 
Let X ~ F(2, n), (n > 2). Show that P(X > k} = [1 + Qk/m] "^. 
Deduce the significance level of F corresponding to the significance level of 
probability p. 
Exercise 22(b) 


m+n 


IEEE os AU, рн XS, are 11.4. МОО, o ?) variates, find the p.d.f. of УХ? / TO 


i=] i=m+ | 


Show how the probability points of F(m, n) can be obtained from those of F(n, m). 
If X and Y are independent Expo (A)- variates, show that Z = (X/Y) has F(2, 2) distribution. 
Hence or otherwise show that Z and Z ' are identically distributed. 


If X ~x, and Y «x? are independent variates, show that U = X + Y, V = nX/mY are 


independently distributed; and identify their distributions. 
If X ~ bin (n, p) and Y - F [2k, 2(n — k + 1)] show that, 
P(X «k] = P(Y» p(n—-k«* l)/kq). 


- If X, | si Snare i.i.d. №0, о?) variates, find the p.d.f. of W= Xy[XX7/n] ^. 


Why W does not follow t-distribution ? 


i Deduce the moments of F(m, n) from those of 19у 


· IfX ~ F(1, n), show that (n — +) п [1+ (X / n)] ~ Yn for large n. 


e the Var (X) from p.d.f. 


of W. 


10. Let X, «37,15 j 3 be independent variates. Prove that 


Х, r. 
ik and Wir e) are independent F-variables. 


11. she ie rvations (x, yj) i= 1, 2, ...,n is drawn from a BYN (His 45, 07,5 


Show that W = [(1- р)5 (1 + p$;]- Fín-1n- D. 


where и, = x + yp V, =x- Yp nii = Eu, n7 = Ev, 


"mE LM маш! оу f" nad: 
TN n=l). $ (uj E ‘ns = L(y, у, 


Each betrayal begins with trust. (Phish) 


Solutions to 
Starred Problems 


Chapter 1 : Elementary Probability : Basic Concepts 


Sec. 1-41. Page 10 ——— x5 ЕТЕТ TE 


1*. East and West together have 26 cards, and these cards include (13 — n) cards of the 
suit $. East (say) has k cards out of these (13 — n) cards of suit S and (13 — k) out 


of the remaining (13 + n) cards. By sequential counting, 
the required probability p is 


“ш Бе) 


The factor 2 signifies the fact that either of the East or West has exactly К trumps. 


2*. Here $ = (1, 2, ..., 17). The set A of numbers which are divisible by 3 or 7 is 
given by A = (3, 6, 9, 12, 15, 7, 14}. Hence by Laplace definition P(A) = 7/17. 

3*. (i) In a leap year, there are 52 weeks + 2 days. These two consecutive days have 
the following possibilities : 

О = {(Sun, Mon), (Mon, Tue) (Tue, Wed), (Wed, Thur), (Thur, Fri), (Fri, Sat), (Sat, Sun) }. 
Of these seven possibilities, only two combinations yield Sundays. Thus to get a Sunday 
in these situations, the probability is 2/7. 

(ii) In a non-leap year, there are 52 weeks + 1 day. This day can be any one of the 
seven-days of the week. Thus, for this day to be Sunday, the probability is 1/7. 


4*. Five tickets can be chosen out of 50 in Lend ways; so n(S) = 3: Since x, = 30, 


tickets x, and x, must come out of the set (1, 2, ...., 29} and tickets x, and x, must: 
come out of the set (31, 32, ..., 50}. By the sequential counting method, tickets Жз, оз 


X, X, can be choosen in el id ways. By Laplace definition, p = (2) 0/(9). 


5*. Since a Bridge-hand consists of 13 cards, the total number of exhaustive cases is 
Nz "n Consider a particular suit, say Diamonds (D). Nine cards of D can be selected 
out of 13 in w ways and the rest of 4 cards can be selected out of 39 


non-diamonds in fe! ways. By Sequential-counting law, 13 cards containing 9 


diamonds can be had in f= a E ways. Hence 


P (4 non-diamonds and 9 diamonds} = yy G/G) (i) 


situation in (i). Hence, the required probability is 
гүзүү 7152 
c 455/09). 
i2 8:4.2 IS ott IU 
ж РЕ + —€— ee, Su | rea! g 
w -i TTET IE pa aeti t055 аа 
Other methods are also possible. 


7*. In a chess-board, there are 8 x 8 = 64 small squares. , 
And any three small squares can be chosen at random 


и 64 
in N = (9%) = 64 x 31 x 21 = 41664 ways. 


To choose 3 small squares so that they lie on a diagonal 
line we observe that they lie on lines such as L,, L,, ..., 
І, BD and lines on the other sides of BD, and an equal 
number of opportunities on the either side of the other 
main diagonal AC. Hence, by the rule of sum, the total 
number f of favourable cases is 


7 2999-000] 
=2 x 46 + 4(35 + 20 + 10 + 4 + 1) = 112 + 280 = 392. 


By Laplace Definition : p = f/ N = 392/41664 = 7/744. 

8*. Six strings aA, bB, cC, dD, eE, fF are shown in the problem. Now a can be tied to 
any one of the five upper ends b, ..., f. One join is ab. Then c can be tied to any one of 
the three upper ends (d, e, f), one join is cd and finally e can be tied only to one point 
f. Thus three are 5 x 3 x 1 = 15 different ways of joining in pairs the upper ends of the 
strings. Likewise, there are 15 different ways of joining the lower ends A, B, ..., F. By 
rule of sequential counting, the total number of ways in which ties are carried out is 
N = 15 x 15 = 225; all tying together being equally likely. 

Favourable Cases : Suppose the upper ends joined yield ab, cd, ef. In order to obtain 
a single ring, it is necessary that A be tied to C or D or E or F (this gives 4 possibilities 
for A). Now if A is joined to C, then B will have to be joined to ends E or F (this gives 
2 possibilities). This leaves only two loose ends, say, D and F, which must be joined 
together. Counting all possibilities, we see that for each of the 15 ways of joining 
A, B,..., Е there are 4 x 2x 1 = 8 ways of joining a, b, ..., f so that the favourable 
outcomes are to 15 x 8 = 120. Hence 


P{a single ring is formed} = t/N = 120/225 = 8/15 
P{at least one ring is formed} = 1 — Р(ф) = 1. 


Comments. If there are 2n strings, then 42] 
М = [(2n—1) Qn-3) 53.1] ; = [2n - 1)... 3.1] [0n -2 Qn-9 7 
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(2n — 2) Qn – 4)...42 А 
р = x D (2n —3)..53 [n = 3 yields the above case] 
9*, Let M, denote that r people have same birth month. Trivially, we may omit event 
M,. The event space is thus expressible : E = (Mi, M, M4, M,, Mj. 
Let J, = [first person has Jan. as birth month], F, = (first person has Feb. as birth 
month}, etc. 
PG, Jy Jy Ja) = PO ... POUD = (1/12). 
So P(M,) =12 x (112)! = oy [ There are 12 different months] 


Again, P{J,, J} J} Fy} = (1/12)*, — [4th born in Feb. etc.] 


Two months out of 12 can be chosen in Д ways. 


And arrangements of 4 objects of two types is 4!/(3! 1!). 
From (J), J5, Jy, F4) = (Е, F5, F4, J4}, we conclude that 


= (12) 41 (1)* __44 
PIMs] = 2( 2) Gs) ЕР 


From P(J, J, F, М} = (1/12)* ; [JJFM); (JFFM), (JFMM), 3 possibilities] and proceeding 


as above 
12) 4! (1Y . 660 
COD а „233 
Pim) = (2) (15) es. — turre. (FFI, J 
ч РТ. ои: 990. 
Рм. = (8). s) ^q» 1728" 
4 (1+ 44 + 660 + 33+ 990) 
We may note that : E PM af PROT rt зорю = 1, 


(а) P(E,) = P(M,) = 660/(12) = 0.38. 

(b) P{L,} = (1 + 44 + 660 + 33)/(12)' = 0.43. 

(с) P(D) = 990/1728 = 0.57. 

10*, (а) If n» N, p = 0 trivially; hence we assume that n < N. The first ball can be 
Placed in any one of N boxes, the second into any one of the remaining 
(N — 1) boxes and so on. Thus, in all there аге N = N(N – 1) (N - 2) ... (N-n + 1) 
different ways to place n balls into N boxes, no box receiving more than one ball. 
Since each of the n balls can go into anyone of the N boxes, in all, there are СА 
different ways of distributing the balls into the boxes. Thus; the required probability, 
by Laplace definition, is p = N/(N)". 
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(b) Let the jth ball be in ith box. Then there are л ^ 1 more balls to К" IN the 
N boxes with no restrictions on where they Ро. viens, ET. ) еге 
ways of distributing these n — 1 balls into the N boxes. Hence p = (М) — KN) = jy 

б З E $ E : We arranoe 
11*. Let the consecutive numbers be x, x + 1, Х + 2, X + 3n 1. We arrange they, 
in three rows, each consisting of n numbers as follows : 


R, -x,x4+3,x46,..., x + Зл — 3. 
К, :x+ 1 х+4, х +7, 4X4 Зп = 
Ry i442, 04 5,x +8, o 4 +381. | 
8 20 14 . "TE, es 2 
12*. P(all are black} = E pan. w- (3) ES} 95 
3\(9 20| 18. d. id 
ibi ay ez OAE] P(b, r, w) = 4 PRW) = 2 
END 5 
Independently, P(BRW) = P(B) Р(КІВ) P(WIBR)= 5g - 19°18 95 


13*. Let A be fixed at any point on the ring, then B can occupy any of the 11 remaining 
places. Of these 11 places, there are only 2 places (B, and B, say) such that the gap 
between A and B is of three places. Hence p = 2/11: [Sample space is assumed to be 
equiprobable]. 

14*. For circular arrangements, we fix one person for counting to commence. This 

gives N = (n + 1) !. Now two groups consisting of k. persons and (n — k) persons 

between A and B can be permuted in А! and (n — К)! and К persons can be selected in 

"C, ways. A and B can also interchange their positions in 2! ways. Hence, the favourable 

number of cases leading to the stated geography f = k! (n — k)! "Eu! -2(n). Thus 

p=fiN = 2(п!)/(п + у= 2/(n +1) 

15*. The entire composition of the event space Q is composed of 24 outcomes: 
(abcd, abdc, acbd, acdb, adbc, adcb, bacd, badc, bcad, dcda, bdac, bdca, 
cabd, cadb, cbad, cbda, cdab, cdba, dabc, dacb, dbac, dbca, dcab, dcba). 

The favourable outcomes include the 6 in the first block, none in the 2nd and 3rd 

blocks, and the first two in the 4th block; totalling in all 8 units. Thus p = 8/24 = 113. 

16*. Gap Method. Let y, be the number of red > g ü Я ка 

Е : 1 2 3 mri 
balls ere B, (first black ball) is drawn, x, be the 
number of red balls drawn ere B, is drawn and 

so on and suppose y,,, , red balls remain after 

B,, is drawn. Then, n being total red balls, we have 
yy t Xo XS E CES YR m SS ДД 20,y,,120,x;» 0. 

Put 1 *yj2x, Ypa +1 92 x,,, then this equation becomes, 


ү ne! 
1 X5 Хз Xm " 


£X. E, ex Pe, ТАЗЕ Л, Emm m+]. 


т+ 1 
The number of solutions, in integers, of this equation is 


Febr 
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m+n ; 
“= | ). S I Афи n+] m+n 
AS бл so p N | » |. 


т 
17*. Suppose that the extraction continues DIS ce а a Une bah. 
The colour of this last ball is obviously the same as the single colour remaining in the 
pna y My mene the single colour remaining is white equals probability 
that the last ball in the urn is white. 


The number f of favourable cases for the last ball to be white is obtained by considering 
that among the w + b — | balls, w — 1 balls were white; hence 


wt+b-1 w+b-] w+b w 
= 5 d = + SS | 
f | rl | “таи | w-1 y w | у + р 


Comments. The result is obvious if we attend to the fact that the last ball to be extracted 


is every bit as random as the first ball and probability that the first ball drawn out is 
white, is w/(w + b). 


18*. The even number of cards drawn means that either 2, or 4, ..., OF 52 cards are 
drawn. Hence by Rule of Sum 


п(5) = (2) (2) ..«(2)22* -1 nen 


This sum is obtained by putting x = 1, n = 52 in the identity 


(1 +x)" + (1 - x)" = x (") ETE OEE ы 221) )+ (8) 


s 4 52 
Let n(R;, В) denote the number of j red and j black cards drawn; then, by Sequential 


Counting, n(R;, B) = H (2 and so 


, = ERICH © 
Put n = 26 in the Hypergeometric Identity, 
n n 1 A 
£06) = £ 00-C) eet 20) =G E 


From (1), (2) and (3) we obtain, 


p -[-1]/e" -» 


Note that = N, - N,- №, · N, and №, are not independent, for P(N | N,) # P(N). 
LIS x, be the number of persons on the left of A and x, be the number of persons 
tight of B. Then 
РОНЕ» x, = 2, i.e. x,*x,-2n-k, x, 2 0, x, 2 0. XA kK B X 
© number of solutions, in integers, of this equation is 


á : N, = ("6925 кылды 
| » 


664 Solutions to Starred Problems m 
As A and B can interchange their positions in 2! ways, the favourable cases are fs2N 
= 2(n + | – k). Further, A can occupy any of (n + 2) slots and then B Mp PeeUpY any of the 
remaining (л + 1) slots, the total number of available slots is N = (n + 2) (n + 1). Hence 
p = fÍN 22(n*1— K)/(n 2).(n +1). 

Sec. 1-56. Page 32 Бш, и МОН 


1*. (a) Suppose A f] B = @ (disjoint events), then AcB (draw Figure), and $0 


P(A) < P(B). 
This is obviously wrong because P(A) > P(B). 
(b) Since AB A, so P(AB) < P(A) = 0. It follows that P(AB) = 0, which is true. 
(c) Suppose О = {e,, e,, ..., es}, p; = P(e) and assign the probabilities 
рү = 9r р, = 50, р, = 20, рл = P: = р, = 40, (Ур, ae = "1/20 = 0.05). 
Define the events A = ley 6s, €,}, B= (e, ез, eg}, then AB = {e,, e,}. Now, 
P(A) = 0.35, P(B) = 0.35, P(AB) = 0.15, p? = (0.35) = 49/400, P(AB) = 15/100; 
P(AB) < р? = 60 < 49 which is false. Thus P(AB) < p, is untrue. 
Note. · P(A) = P(B). but A = B. 
(d) Let Q and р, be as in part (c). We define the events : A = Ie b B = tfe, e, e, e, €). 


Now B = {е} and A = (е, е, ез, е, е„ e). Obviously P(A) = 0.20 = P(B), but AB 


2*. Let D, denote rth-numbered draw. Now event A occurs if odd-numbered balls are 
chosen on D, and D, (event A,) or on D, and D; (event A,) or on D, and D, (event Aj). 


As А =A, БА, U Ау, we have 
P(A) = P(A, Е! А, t A,)=P(A,) + P(A,) + P(A,) = 3P(A,). [by symmetry]. 


eee A 
MAESE POR a © RE BE? [O = odd, E = even] 


10 
P(A) = 15/126 = 5/42. 


3*. Four cards can be selected out of 52 cards in 99 ways. To find the number of 


favourable cases, we exhibit the deck and possible favourable selection as under : 
dd Spade Non-spade Spade Non-spade 
ace (1) ace (3) non-ace (12) | non-ace (36) 
A 1 1 
В 2 2 


There are two disjoint possibilities A апа В as indicated above. 


ra= (т) GS) mens: ^ - Q2) G5) - 88 


р =Р(А U B) = (1296 + 198)/270725 = 1494/270725. 
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4*. Denote the drawing of "white ball from urn i by W, and black ball from urn j and 
g”. Now. 
j 


9 Р) 
Sus. ТАА 1 


EE E 2 +, 2 
ERE: — PWBWjsl.l.i--— 
pWW;BJ7 3:4:5- 60° "(ME W)-3. o A 5. 60 


y ууа, 028 


= 60 60 60 60 

5*, We are in for a chance when three balls are either all of one colour [event C,] or these 

are of two colours [event С,]. For event C,, 3 red balls is the only obvious possibility. 
C, ={(2r, 1g) U Qr, ly) O Qg, ly) U (2, 1n]. 

If L, denotes the event that at least one colour is not drawn, then L, = C, U C, and 


raare ro OOOO OOOO- 


6*. After the insertion of 3 yellow (y) balls, the composition of the box is as under : 
A= (3w, Ob, 3y), B = (2w, 1b, 3y), C = (1w, 2b, 3y), D = (Ow, 3b, 3y). [w = white b = black] 
Let E = {three balls drawn out are of different colours}. Clearly, the compositions A 
and D are incompatible with E. We can then have; from sets B and C, 


no -POOO OONO]: 


Note. P,(W, В, Ү,) = 2/6 . 1/5 . 3/4 = P,(W, Y, В.) 
= P, (B, W, Y.) = Р (В, Y, W3) = РУ B, W3) = P(Y, W; B3). 
Thus, if order is considered even then p = рр + pc = 6(1/20 + 1/20) = 3/5. 
7*. Let W, R, B denote the number of white, red and black balls among the four 
drawn out. Then 


edo 15y.:126 - 42 
EU U- an a) 1365 455° 


Ls 15x36. 36 
(b) na-2.3-2-(S)/(5)- ^s 5r 
(c) p= P((W 2 4) U (R=4) t (B-4)) = P(W = 4) + P(R = 4) + P (B = 4) 
р = П) +) + ЈС). = (1+5 + 15)/1365 = 1/65. 


ШШЕ (w= 1,R=1,8=2) У (и= 1, к= 2,8= 1) 0 (И = 2. к= 1, B=}. 
3 PE) = Pw = 1,R=1,B=2)+ P(W=1,R=2.B=1)+P(W=2,R=1, B= 1) 


4\(5\ (6) /4\(5\(6) (4) (5) (6 
А 00 + DOG Mie + OON — (300 + 240 + 180) / 1365 = 720/1365 = 48/91. 


О ММ = ____ 


8*. We designate the events : 
C = (Void in Clubs}, D = (Void in Diamonds}, H = {Void in Hearts}, 5 = {Void in Spades} 


Now, by symmetry, 

P(C) = P(D) = P(H) = P(S); P(CD) = P(CH) = P(CS) = P(DH) = P(DS) = Pus, 
P(CDH) = P(CDS) = P(DHS) = Р(СНЗ); P(CDHS) = P() = 0. [Void in all suits is impossible | 
So p = P(C U D U HU S) = 4P(C) – 6P(CD) + 4P(CDH) – P(CDHS) [Poincare’s formula] 

is] =f -1 
_ 4 (39) (52 26\(52 521^ үздү, «(26 41009). 

Е = 18763) –6(13)(8) *«4(5) - «(55 613) + (5) 

9*. We define the events as under : 


A = {All the four suits appear among the n cards} 
B = {At least one of the four suits does not occur among the п cards] 


Obviously, B = A or A=B so that P(A) 2 1- P(B) 
Let C, D, H, S denote the absence of clubs, hearts, diamonds and spades among the 
Six cards, so 

P(B) = P{C U D UH U S} = 4P(C) - 6P(CD) + 4P(CHD) — P(CDHS) do 
Since, by symmetry, P(C) - P(D), etc. Also CDHS = ©, so P(CDHS) = 0. Because the 
cards are replaced, the probabilities do not alter from trial to trial. Thus, for n draws 
with replacement 
Р(С) =(3/4)", P(CD) = (1/27,  P(CDH) = (V4) 
Substituting into (2), using (1) we obtain 

P(A) =1 – 4(0.75)" + 6(0.5)" — 4(0.25) [л = 6, P(A) = 0.381] 

10*. Let A, B, C denote the respective events that “at least one ball enters the box В, 
B,, B, respectively". Now probability of a ball entering B, is 1/3, that of not entering 
B, is 2/3. Hence P(A) = (2/3)", [none of the n balls enters В|]. Similarly 


AT 


P(AB)=(1/3)", since AB means all the n balls enter B}, and P(ABC) = P(@) - 0. 


P(A UB UC) = ЗР(А) -3P(AB) + P(ABC) = 3(2/ 3)” – 3(1/3)" +0 = (2" -1)/3" 
If X denotes the number of empty boxes, then 


(a) P(X = 0} = 1- PAUBUC)=(3""' – 2" + 1)/3"-!. 
(b) Р{Х = 2) = P(ABUBCUCAU ABC) = ЗР(АВ) + P(@) 21/3"! . 


(с) P{(X =0)0(X =NU(X = 2) =1. 
P(X = 1) = 1 - P(X = 0) – P(X 22) = Q" - 2y3"- £. 
11*. The following chain of subset relations is obvious : 
ОсАПВСАСАЦВСА 6 В. "b 
We apply Monotonicity of probability measure to (i), considering the pairs one ? 
time; this gives 
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) SP(AB) x P(A) < Р EL ee 29 

| s P(A) < P(A U B) < P(A В). 
Since РО) = 0, and P(A U B) = P(A) + P(B) – P(AB) < P(A) + P(B), we get 
“ os P(AB) s mın UNA), P( B)} <. P(A U B) « P(A) 5 Р( В). [АВ ‹ A. АВ с В| 
12*. From stated condition : A N В c C, we get P(AB) < P(C) | 
2 PAU B) = P(A) + P(B) - AB) < 1, > P(A)«P (С 
ie. NO 2 PLA) + P(B) — 1. (A) + P(B) € 1 + P(AB) < 1 + P(C), 
By Negation: 1-P(C)21-P(A)+1-P(B)-1 > P(C) < P(A) + P(B). 
13*. From Bon-Ferroni'a inequality P(AB) > P(A) + P(B) - 1 209 + 0.8 – 1 = 0.7. 
14*. p A denote the event that there is at least one pair among r shoes selected. 
Then 4 denotes the event that there are no pairs among the r selected shoes. We 
investigate P(A’). 


нич DN 
P e — 


Observe that r shoes can be chosen out of 2n shoes in № = E ways. This is precisely 


— the number of subsets of size r obtainable from a set of size 2л. 


— Let us choose r pairs out of n pairs, this can be accomplished in (") ways. From each 
— ef these r pairs, we select only one of these two shoes. Obviously, there are 


80-07 ways of doing it. By Sequential Counting, f = (").(2") of the events in 
A sf scify collection of shoes with no pair. Thus 
x n 2. x H^ r 2n 
з) тач [ey] 


a Эз» А Д 
e. Forn = 10, r = 4, P(A) = 1 aes 


t Let Q, be the probability that in k drawings, none of the tickets bearing numbers » 
3, .... n appear. Then P, = 1 - Q, is the probability sought. We define the events : 
{ticket numbered i does not appear in one draw} ; T, = (ticket numbered i does not 


JA : л ү аст pn 
е. y) п -(1 4 | 
NT) = PIG), (ta - (91) = PEDI = D - (min) 
| | k k 
D. à -2 m LA. d m m i 
M - ("; y)-6-5X =). ran «(i 4 \ = | 
Ne L eli E : m. Y 
Bones S Cg 
MEL Formula :Q,95,-352*5-94* 7 
y ч 1 - * } d ( 3 (1-4) 
(80-2). s «sem (0-5) Uae) 
P > 
ix 


" Ñ 


= 
An 
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k kf k 

E n m Р т ү- т | | 
s,=EP(7,7,7,)=(5)(1- "| m) | a 
P,=1-Q,=1-S,+5,-5,+5,--- 
k k К К К i 
= n m n m m [n =z) Mw m | í m \ | 
L (0-5) +(3)(1-2) (1-5) (t n | n-1 n z | 
Sec. 1-63. Page 41 ————M 


1*. From given data: P(AB) = rp, P(B) = rplq, P(A) = Р: 
(a) P(AB) = 0 => rp = 0. 
(b) P(A) + P(B) = 1 > p(q* ғ) = 4; rp» 0 > ра = 4: 
(c) АсВ>А (ПВ = А, so Р(АВ) = P(A) > rp = 4. 

BCA = АВ = В, so Р(АВ) = P(B) = rp = (rplq) or rp(1 — q) = 0. 
(d) 0= Р(АВ) = 1- P(AUB)=1-[P(A) + Р(В) – Р(АВ)] = 1– p — (p! 4) + rp. 
Thus p(q +r) 2q(1 + pr). 
2*. Consider a biased tetrahedron with faces a, b, c, d with probabilities 0, 20, 20, 50 
(0 = 1) of falling down. Let A = (a, b, d), B = (b, c), C = (a, b, c), then P(A) = 86, 
P(B) = 40, P(C) = 50. Obviously P(A) > P(B). Also P(AC) = 307 P( BC) = 40. 
Clearly, P(A/C) + P(B1C), [- P(AC) < Р(ВС)]. 
Note. If you take B = C, then P(A) > P(B) > A has more atoms than B. As such, 
P(A | C) which has a meaning if A c C is ruled out. 

P(ABC) P(BC). P(ABC) P(AB 

3*. P(CIAB) = P(C1B) > a s VU = ру > P(ALBO - PAL 
4*. FromA, СА, UA, C BB, с B, it follows that A, C В|. Similarly, А, C Bj, A; C B, A; C В, 
Now P(A | В) = P(AB)/P(B) = P(A)/P(B) IG SATB A, as A c B] ..(1) 
Using (1) we obtain 


_ P(A) F(A) P(A) P(A) _ 
P(A, | B,) P(A; ! Bs) = pg PE) PCB) PB) ИВО РАВ). ly (1)] 


s". P (AN В) =P(A N 9, В) = PG, AB) = XP(AB) = EP(B) P(A1B) — 
-pLP(B)-p.P(B) [^ P(B) = EP(B)] (%) 
га P(A 1 B) = Р(АВ)/Р(В) = pP(B)/P(B) = p. 
6*. Here О -(H, TH, TTH, TTT} ; with the associated data : 
P(A) = 1/2, Р(ТН) = 1/4,  P(TTH) = P(TTT) = 1/8. 
Let A = {Мо head on first toss} = (TH, ТТН, TTT}, so P(A) = 1/2: 
Let В = (Coin is tossed three times} = (ТТН, TTT}, so P(B) = 1/4. 


A N B = В so P(AB) = P(B) = 1/4. Consequently, P(B | А) = P(AB)/P(A) = 2/4 = V7: 
7*. Let J, denote that kth card is a Jack and T denote the occurrence of a ten. Now 


4 4 p 
P(J, mu a (b) P(J, Ј,) = iu 


mad "eM ey 


(a) P(J,1J,) = 


oo — 0 Selutionsto S tarred Problems 6 6 9 


D 
P(T\J,) = О.Х. ША. 
(с) À PU, “л 


g*. We define the events : 


: = {Exactly 3 defectives obtained in 9 examined } 
= {10th examined piece is defective} 


x Po» (3)(8)/(5)= 22. 
P(B | A) = 1/6, so P(AB) = P(A) P(B | A) = 4/65. 


9*, Let B, denote the event that a black ball is selected on the ith trial. We need 
P(B, B; B4). So 


P(B, B, B) = P(B,) P(B, | Bj) P(B,1 B, B,) = 2 5. Lx 
10*. Let the four cards drawn be A, B, C, D, then 
P(ABCD) = P(A) . P(B | A) . P(C | AB) . P(D | ABC) [Product Rule] ...(1) 
(a) Now P(A) = 40/40, P(B | A) = 30/39, P(C | AB) = 20/38, P(D | ABC) = 10/37. 


40 30 20 10 .1C00 


(b) Here P(A) = 40/40; cancel suit and denomination of A to get P(B | A) = 27/39. 
Similarly, 
P(ClAB) = 16/38, PUR ABG) =, 7/37 
40. 27 16. [= 304 


11%. Let A = (At least one 6 in 4 tosses of a single die}, B = {At least one double-6 in 
24 tosses of 2 fair dice]. 
Then P(A) = 1- P(A) = 1 —P(no six in 4 tosses of опе die) = 1 — (5/6)* = 0.518. 
P(B) = 1- P(B) = 1 — P(no double-6 in 24 tosses of dice-pair) = 1 – (35/36)"^ = 0.491. 
12*, (i) Let В, denote that jth ball withdrawn, is not black. Then 

P(B) = 47/50, P(B,) = 46/49, P(B,) = 45/48, 


47 - (r-2) 3 М 
PB.) = 5020-2)" „РВ, Ре sie el m [rth : black ball]. 
Thus, the probability P,, the rth ball drawn is the first black ball, is 
47 46 45 fim 43 e EAL Бнр! РЕР ЯРИ [Product Rule] 


P, = 5°40 48 47 46 45 50-(r-2) 50-(r-1) 
3(49 — ғ) (50 - r)(51-r) (49-0) (50) 
7 7 50.49.48(51-r) 39200 
(ii) In case balls are replaced 
P(B,) = 47/50 = P(B,) =... = Р(В, 1): Р(В,) = 3/50 


r= r-l 
b COEM 47 2517) WR Ан 
8 50 50°`50)`50 \50 50 (50) 
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plete suit. By Symmetry 


13*. Let A, B, С, D denote the events that four players get a comi 
of distribution 
P(A) = P(B) = P(C) = P(D), P(AB) = ... = P(CD), etc. Now by Poincare's Formula 
р = Р(А UBUCUD= S} — $4 + 5, - $4 
= 4P(A) — 6P(AB) + 4P(ABC) – P(ABCD) 


As P(A) = 4/°°C,, P(AB) = P(A) P(B | A) = Hia) 1 3) 


pase =ro rian = [4/6 9/69) (69) 


Substitutions into (1) provide, after simplification 
p ={16(39! 13 1) – 72[13 ! 13! 26 !] + 72(13!)°}/521. 

14*. Definition : Two events A and B are said to be equivalent : A occurs iff B occurs, 
i.e., they are equal as sets. Thus, if A and В are equivalent, they have the same probability 
measure, i.e., P(A) = P(B). 

P(AUBUOC) = ХР(А) - XP(AB) + Р(АВС) [Poincare's Formula] 
Using given condition this simplifies to УР(А) — XP(AB) = 0. 

[P(A) — P(AB)] + [P(B) – Р(ВС)] + [P(C) - P(CA)] = 0. 

or P(A) [1 — Р(ВІА)] + P(B) [1 - P(C | B)] + P(O) [1 - P(A | C)] = 0. 
This result can hold iff P(B | A) = P(C | В) = P(A! C) = 1. at) 
Similarly P(A 1 В) = Р(ВІС) = Р(СТА) = 1. AH) 
From (i) and (ii) we conclude that P(A) = P(B) = P(C). Consequently A, B, C are equivalent. 


Sec. 1-90. Page 52 


IP(ABCD) P(ABC)} (1) 


1*. Since A N B = Ø, we must have A c B and Bc A. [Draw Figure] 
Hence by Monotonic law, P(A) < P(B) and P(B) < P(A). 

Aliter: P(A О B) < 1 = P(A) + Р(В) < 1. .. (1) 
Thus P(A) < P(B) and Р(В) < P(A). [both by Complement Rule] 


2*. Denote the events : C = (both balls are of the same colour}, N = (both balls bear 
the same number). Since the two balls of the same colour have the same number. 
СОМ @. Thus 
P(C 9 М) = P(C) + P(N). mU 


The number of ways in which the pair (two balls) consists of 2 white balls is (") same 


is true for the pair to consist of two red balls or two black balls. Hence by the Rule А 
Sum, the total number of ways in which the pair chosen consists of two balls of tt 
same colour is 3(") ways. Since the total number of ways in which 2 balls Сап be 


a fie. 
chosen out of 3л balls is bi ; hence P(C) = x) wt cQ 


Both chosen balls bear No. | if these are white-red, white-black or red-bl here 
for cardinality 1, there are 3 ways. Same is true for numbers 2 through л. hus I 


are 3n ways for N to materialize. Consequently, P(N) = w/ "a 
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ARCU N) = P(C) + P(N) = l3 n / 3n | IP bi Lai "— "" = 
| 0) (2) 135 (3) nm 1; 


3*. Let A, B, C denote the events that the misplacement h 
York and in London, respectively and M denote the event that luggage has been 
misplaced. Then A, B, C are incompatible (m-e) events and M = AUABUABC. 
P(M) = P(A) + P(AB) + P(ABC) = P(A) + P(B). P(A) + P(A). P(B). P(C) 


where we believe that staff in different airports misbehave independently of one another. 
Thus, using p + q = 1, the needed probabilities are : 


P(M) 7 q + pq * pq = ql * p + p) = q1—py(1- py 1 p. 
P(A | M) = P(AM)/P(M) = P(A)/P(M) = q/(1 — p^. 


P(ABIM) = P(AB(\ M)! P(M) = P(AB)/ РОМ) = qp!Y1— p°). 
P(ABCIM) = Р(АВС [| M)/ P(M) = P(ABC)/ P(M) = p’q/(1— p°). 


appened in Iowa, in New 


Chapter 2 : Probabilistic Independence. Baye’s Reversal Rule 
Sec. 2-12. Page 63 
1*. Write P(B) = x. By Multistage Rule 


P(A) = P(B) Р(АІВ) + P(B) Р(А1В)= xP(AIB) + (1- x) P(AIB). 
By Section Formula of Geometry, this result implies that P(A) lies between P(A | B) 
and P(AIB). 
The extreme values of P(A) are attained when x = 0 and x = 1. Thus, the two possibilities are 
P(A | B) € P(A) € P(AIB) ; P(AIB) < P(A) < P(A | B). acti 

When A and B are independent, each member of (1) is merely P(A). 
2*. Define the events : E = (2nd card C, covers the first card С) 

$ = (Cards C, and C, drawn out are of the same suit} 

D = {Cards C, and C, drawn out are of the different suits} 


347124 i i 
- P(E D) = 0 (trivally). P(S) = 25:517 17 [C, is of arbitrary suit and C, has same 


Suit as that of C J 
In case event 5 occurs, the equiprobability provides 
PIC, covers С, }= P(C, covers C) > PHRES) = 12 
i 4:1] 2 | 
^ P(E) = P(S) P(E | S) + PD) P(E | D) = 77% 3+ 07 77 [Multistage p-Rule] 
Note. Ace is regarded superior to King. We may assign values 2, 3, ..., .13, 14 (ace) to 
Cards in any other method of evaluation. 
* The sample space consists of three m.e. possib 
15 (А, is the Ist card (hence К, is 2nd card)}; 


A K, is 51st card)]. 
MEM. 


ilities (events) C,, C5, С, as under : 
C, = (A, is the last 152nd) card 
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C, = {A, is somewhere in the middle (K, A, or A, k, occur)}. Let tE. = = {Ki IS NEXt to A | 
кл C, Ө C, U G, ; Р(С) = Р(С,) = 51 1/52! = 1/52, Р(С,) = 50C,/52C, = soy. 
Düse that only one card is next to the top or bottom cards and 2 c: ards are ne Xt to « 
card within the deck, we have P(E | C,) = 1/51 = P(E + C,). 
P(E | C4) = 2/51, (К,А, О A, К]. Now by, Multi-stage p-Rule. 


ТЕ WSs) 212,1 


P(E) = XP(C,) P(EIC,) = 52°51 52/581 52/581. 52 26 

4*. Define the events : 

E = (person selected is employed), M = {person chosen is man}, W = {person chosen 
is women}. Then P(M) = P(W) = +. Now by Multi-stage p-Rule. 


P(E) = P(M) PAM) + PW) P(EIW) =>. +s: 23 = 0.725. 


5*. Let the urns be A and B, and E be the event of interest. Then by Multi-stage 
p-Rule, (since P(A) = P(B) = 1/2). 
P(E) = P(A) P(E | A) + P(B) P(E | B) = +[Р(ЕТА) + P(E1B)] 


Е = {30г6), P(3 or 6}= 4[2+4]=4. 


Pia 6) = 12+ |н ES 10}=3] 4+ Ьп ‚ PS)- 1 +0). d рој Ios 1... 


6*. Let R,, B,, К, denote the events that the first ball drawn is red, first ball drawn is 
black and the second ball drawn is red. Then 


P{R,} = 2, P(Bj) = $,P(R,IR) = 2, R,IB) = 2 
2. P(R)) = PUR) РОК, ТЕ) + P(B,} P(R,1B,] = 2.2+ $.3 = 2: — 1. [Multi-stage p-Rule) 


Thus result is, as if nothing is thrown away and we draw a red ball as is from original conten’ 
Note. If we know the colour of the first ball, probability P{R,} is changed. 
(i) p = 2/8, if the first ball is red. (п) p = 3/8, if the first ball is back. 


7*. Let B denote the rth ball and B, = k means rth ball chosen is numbered 4 B) 


Multi-stage p-Rule 
Р{В,= 3) = ХР(В, =r) P((B, eb Qs Ssrt3 O, 


REGN l 
- iii 23' СЕ 
8*. The probability that the first sample S, contains г white ball is 
_ (WA(N - м м 
p= ("NVA 


The probability that the second sample 5, of size m contains k white balls is 


pa = QI 
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We now use Theorem of Total Causes EM n,n F 


so get p = P{S, contains k white balls} 


NU. 
и EDU күз by reduction. 


Observe that, the first sample has no bearing on that final outcome. 

9", Les C, be the event that a family has exactly n children and B, be the event that a 
family has no boy. Then by hypothesis, P(C,] = (1/2)" and given C,, B, requires n 
е P(B, | С.) = (1/2)", for every n = 1, 2, ... By Multi-stage Rule : 


P(B,) = 2, P(C,) P(B, IC,) = Y" =1 Yay = 1, 
a п= | neo > 


Note that; P(C,18,) = "НС RIC NPB ys 3/4. 
10*. We define the events : A = (First a tosses alt result in heads} 

B = {Last b tosses all result in heads}, C, = (Coin chosen has : P(H) = k/n} 
We require P(B | A), which by Multi-stage Rule, is given by 
P(AB) _ = P(ABIC,) P(C,) У (К/п)"*° (1/n) 
P(A) = ZP(AIC,)P(C,) — Xx(kinf (n) ’ 


because, by the assumption concerning the method of choosing the coin to be tossed, 
we have, a priori, that P(C,) = 1/n. Now using Euler-Maclaurin's summation formula, 


lim $ (5) (2) - 


Hence, when n is large, using (2) into (1) we get, 


1/(а+Ь+1)_ atl 
Е iit), abel (n large). 


P(B 1A) = l<k<n "Wi: 


e^ eem 
х mecs 222) 


11*. We define the following events : 
C,- (A family has m children}, В, = {A family has m boys} 


We аге given: Р, =P{C,} =ap",m=0, 1, 2, 3, .. em 
Since each sex distribution is equiprobable, 
WEKT AK — (m\(1\" 


Y P(C,,) PIB, ic, - Zop" (4) (5) » [by (1) апа (2)] [Multi-stage Rule] 
m-k 


Ф k+r 1 k 1 —(k+1) 
0010 -а |5) (i-r) , [Using m -k =r] 


r=0 


ы: -n_ ч{п+к—1\ г 
2op (2 — py. Ё (1- T) - и | 


В, 
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T—— ra wm $ Fam д6; "as * boy € { PT 
(b) Let L, and L, denote the events that the family has at least one boy and at least two 


boys. Then, 


x а = p do pl(2— р) ap 
d us P 5 e . | | 
PUY >1)= P{L,) ZPO 2 һәр, 2- p 1-[p/(2- pl (1— p)(2- p) 


A 2109 ? { 

Д 20 е. р 20 р /(2 p) ap 
E = Р = d : s -_-— =~, : 
P(Y 22) = P{L,} LP je i| ] uou p! 1 [p/(2-p)] (1-р) (2 p) 


Observe that P( Y > 1, Y > 2) = P(Y > 2}, hence 
P(Y,21Y21 Р(}, 21) [ 


um КЪТ Pel). 2-р. 


Sec. 2.25. Page 75 —————— ———— 


1*. P(B) = 1- P(B) = 1, P(AU B) = P(A) + P(B) - P(AB) => 5 = P(A) + 1 - 12» P(A) = 2. 


As P(AB) = += Р(А).Р(В), it follows that A and B are independent. 


2*. Suppose on the contrary, that the events are independent. 
P(A,A,A,) = P(A,) Р(А,) P(A) = P, Pa Рз: | zaLT) 
The stated property then provides P(A,A,) = P(A,A;) = P(A,A, = P(A,A5A4) — pp; = PP, 


Teh P 18228: 
These relations imply that p, = 1, p; = 1, p, = 1 which contradicts the hypothesis 


O € р, < 1. Hence, these events are not independent. 
Concrete Illustration. We throw two dice D, and D, and define the events : 

A = (D, shows a 6} = ((6, 1), (6, 2), (6, 3), (6, 4), (6, 5), GO: P(A) = 1/6 

B = (D, shows a 6} = {(1, 6), (2, 6), (3, 6), (4, 6), (5, 6), (6, 6)}; P(B) = 1/6 

C = {D,, D, show the same numbers 5255. (6,.6) ; PCC) = 1/6 
АПВ= ВП С= СПА= АПВПС = ((6, 6) = P(AB) = P(BC) = P(CA) = P(ABC). 
Obviously, P(AB) = 1/36 = P(A) P(B), etc. But Р(АВС) = 1/36 # P(A) Р(В) P(C) = 1/216. 
Consequently, these events are not independent. 
3*. Firstly we not that if P(B) = 1, then КА ; B) and I(B ; C) are always true. To see this, 
we notice that A U B 2 B = P(A UB) > P(B) = 1. 
Since no probability measure can exceed unity, this result gives 

P(A UB) =1 = P(A) + P(B) - P(AB) = 1. 

Thus, P(AB) = P(A) = P(A) . 1 = P(A) P(B), so that (А ; B) holds. 
We now choose A and C to be dependent events; the consequences are /(A ; B) and КВ; ke 
but these relation do not imply /(A ; C) because by hypothesis A and C are dependent events. 
Note. This example shows that /(A ; B) is not an equivalence relation. 
4*. P[(AB) N С] = P(ABC) = P(A) P(B) P(C) = P(AB) P(C) since, P(AB) = P(A) P(B). 
This show that /(AB ; C) is true. 


) 
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Now let B = Ø and suppose A and С are dependent events Then 
P(AB) = Р(@) = 0 = P(A) P(B) ; P(ABC) = P(@) = 0 = P(A) P(B) P(C) 
It follows that, the events A and C are dependent though the above conditions hold 
5*, (i) This is a false assertion. Roll two dice D, and D, and let A = (sum of eyes is 7} 
B = (D, does not show face 6), "à (D, does not show face 1) 
P{7, not (6, 1 5/3 
Then P(AIBUC) = UNDA е T == P(A). 
(ii) Р{А(В О C)) = P(AB У AC} = P(AB) + Р(АС) = P(A) [P(B) + P(C)] = P(A). P(B Э C). [True] 
6*. By Poincares’ formula and independence 
P(AB U BC U СА) = Р(АВ) + Р(ВС) + P(CA) – 3P(ABC) + P(ABC) 
= P(A) P(B) + P(B) P(C) + P(C) P(A) - 2P(A) P(B) P(C) = pq + qr + rp - 2pqr. 
7*. Let A U B = C, A ПВ = Р, then using P(AB) = P(A) P(B), 
P(C) = P(A) + P(B) – P(A) P(B) ; P(D) = P(A) P(B), P(C N D) = P(D) + P(C) P(D) 


г СПР = р 
This establishes that С and D аге not indep. events. 
8*. P(A(1(BU O)} = P(ABU AC} = P(AB) + P(AC) - [P(A) (BC)] PA a 
= P(A) P(B) + P(A) P(C) – P(A) Р(ВС) = P(A) [P(B) + P(C) – Р(ВС)] 
= P(A) Р(В U C). [i.e., А is independent of B U C] 


Remark. A is Completely independent of B and C means A is independent of B, C and 
B N C. That is why in (i), P(ABC) = P(A) P(BC). 


9*, (a) P(AB) = P(A) Р(ВІА) = т, P(B) = P(AB)/ Р(АІВ) = d 

(i) Since P(AB) = 1+0. AN B®. [False] 
(1) Since A c B > AB = А, so P(AB) = P(A). This is false too. 

(iii) Since P(A) = P(A | B) = ҚА ; B) > КА; В) hence 


P(AIB) = Р(А)=1- Р(А) = 3 [True] 
(iv) Since A and B are independent, it follows that 
Р(А1В)+ Р(А1В) = P(A) + P(A) = 2P(A) = 5 #1. [False] 
(b _ P(ABC) _ P(A) P(BC) : B) and КА; BC) 
) P(C | AB) PAB ^ P(A) PCB) [By МА; B) and K ] 
= P(A). P(B). P(C) _ by КВ; C)] 
TE IE P(C). [by А 


lo*, Let P(B) = y and P(C) = z, set 1 -a- a, 1 -be b, 1- с=с, 1-у= у, 1-2=2, 
Now x = P(A'B'C) = P{(A U В) C] = P(C) - PICA U B) C] = P(C) - PIAC U BOJ 
=P(C) - P(AC) — P(BC) + P(ABC) = P(C) - P(A) P(C) - P(B) P(C) + P(A) P(B) P(C), (Бу Indep.] 
Sell- a- y + ay} = 1-а) (1 7 y) = za' у eo 
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b=1-P(AUBUC)=P(A'B'C) = P(A’) Pee oP (Cum a. y' .z' 


c = 1 — (АВС) = 1 = P(A) P(B) P(C) = 1 ~ ayz vl 33 

From (1) and (2) : x/b = zi? => z = х/(х + b) = P(C). ЖТ", 
X х+ b)c' 

From (4) and (3) : ZZ = с => y Ste. P(B). „55 

x+b ax 

x pee) | na ас) — bc' | 

DI EE м y'= |- y= = | 

From (1), (4) and (5): x e | vm } A | 

ax (x + b) 2 a' [x(a — с) - bc'], or ax’ + [ab + a’ (c' - a)] x + а Ьс = 0. ...(6) 


This is equivalent to Eq. (A). Further, x being a probability value, both roots x,, x, of 
Eq. (6) must be positive and hence x, + х > 0. This yields that the Coefficient of x be 
negative. Thus 
1-а)? «ab 
a'(a - c) » ab > а гар = guam Uim зао DO 
a a (1— a) 
11*. Let P(A) mean the probability that A can solve the problem, with similar meanings 
attached to P(B) and P(C). Since A, B, C solve problem independently, the required 
probability p is 


p =P{AUBUC} = I- P(A) (B) P(C) 2»1-1.2.3-3 
12*, Here P(A) Spies =, P(B)= р, = 2, Р(С) =p,= 3. 
Р(АВС) = ppp, =2 .2 = [all three hit the target independently] 


- 12 = 27 = 
P(ABC) = d P»Ps = 19g: P(ABC) = р9›рҳ = 100 P(ABC)- рур; = К (С alone misses). 
Let us define the events and their probabilities : 


P(E,) = P{Exactly one of the shots hit} = P{ABC U ABC ЦАВС}= 4р» +q, Pd; + р: 
P(E,) = P{Exactly 2 shots hit} = P{ABCU ABC U ABC} = 4\р›ру + pido ps + PiP293- 
P(L,) = P{At least 2 shots hit} = P{E, О ABC} = Р(Е,) + p Paps. 
(a) Р(Е,) = (12 + 27 + 6)/100 = 45/100. 
(b) P(E,) = (18 + 4 + 9)/100 = 31/100. 
(c) P{L,} = P(E,) + P(ABC) = 0.45 + 0.18 = 0.63. 
(d) P{A | E,} = P(A N E,)/P(E,) = P(B CA)/ Р(Е,) = (9/100) / (31/100) = 9/31. 
(e) Р{СТЕ,} = P{ABC}/ P(E,)=6/45 - 2/15. 
13*. Since A, are independent events so A, must also be independent events. Thus, 
p = P{A,, A,,...,A,}= P(A,) Р(А,)... P(A,) = (I= p) (I р,)...(1- p) 
To find the stated inequality, we observe that 
" (2) 
& z(l-0,0st < 1. 
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Replacing / by Pi Po ..., р,, 


we get by repeated anniince: "hene и 
get by repeated application of (2), using (1) : 


(1- p) (i - ЛЕЧЕ p,) 5 


e ^ егі) i а 

, TT > pP Sexp (~ Хр). 
Note. |f Хр; o then p > 0 as n > o0. 
14*. A figure for three events А.А, 


z¢A,A,A, > 


‚ A, instantly provides : 


a € (A, A, A, U A, A, A, tt A, A, A, oO A, A, A,). 
- Piz € A,A,A,} ji 9993 + Pi 993 + 9193 + 919р% = ql | (p,/q,) + (p,/q>) + (p,/q,), [q = qq da] 
We now extend it to r subsets. Let A = A, A, ..., А; then (x, € A), х, EA, ., x, € A 


p= Pix, € A, Xy € AJ = (Р(Рх e A" = {q [1 + SONT DSI Si Uy giis... а, 


— c EDO Sec. 2-53. Page 87 


1*. Let A = [sum total of 9 on three dice}. A suitable decomposition of 5 is as under : 
B, = (15,2,6), B, = (1,3, 5}, В, = (1,4, 4}, B, = (2,2, 5), B, = (2, 3, 4}, B, = (3, 3, 3). 
B, = {sum total different from 9}. Various triplets are in some order. 
Obviously, P(AB;) = P(B), j = 1, 2, ..., 6 P(AB,) = 0. By Baye's Reversal Rule : 
P(B; | A) = P(B,)/[P(B,) +... Р(В,)] = p/(6p + 6p + 3p + 3p + 6p + p) = 1/25. [р = 1/216]. 
2*. Since P(H) = P(C,) P(H | C) + Р(С.) P(H 1 C.) = (3/4) (1/2) + (1/4) . 1 = 5/8 
- P(C, | H) = P(C,) . P(H | CjJP(H) = (1/4) . 15/8) = 2/5. 
3*, If P(A) denotes the probability that A is appointed manager, with like meanings 
for P(B) and P(C), then we are given that P(A) = 4/9, P(B) = 2/9, P(C) = 3/9. 
If E denotes the event : Bonus Scheme is introduced; then we have 
POETA) ОЗ P(E | B) = 0.5, Р(Е1 C) = 0.8 
* P(E) = P(A) P(E\ A) + P(B) P(E| B) + P(C) Р(Е\ С). [Multi-Stage p-Rule] 
4 225115: & 1746 
ES 5-15*2.10 9 10 90 : 
Now by Bayes's Reversal Theorem : P(A | E) = AE rie 
4*. Let the No. of blue and red in the bag be b and r respectively. Let B, апа R, denote the 
drawing of k blue and k red balls. Then [draw figure as for hyp-geom model]. 


r\(b\ /(r+b\_ r=) 
x= рк()(") 2) (r+b)(r+b-1) 
b d r+b чч b(b — 1) ES 
у = B.)(5)(5) 2 ~ (r+b)(r+b-1) 


Eat ЖЕ... 
z = P(B, eX) 2 ттт 


Ву hypotheses x= Sy, z= 6y >rr- 1) = 5b(b — DA 2rb d = ]). 
Olving : р = | 3 and then r = 0, 6. So the admissible solution is b = 3, r= | 
* If event A. denotes the ith urn chosen and ‘R’ denotes the event of withdrawing 
l ball, then 


6. 
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P(A,) = P(A = P(A;) = L [Urn-selection is equiprobable] 


P(RIA) = 4, Р(АТА,) = $, PCR | A3) = 4/9. 

P(R) = P(A,) p(RIA,) + P(A,) Р(КІА,) + P(A3) PIR 1A) = 71/216. 
So P(A, | R) = Р(КТА,) P(A,)/P(R) = (1/18) (216/71) = 12/71. [Baye's Reversal Rule 
6*. Denote by 7, E, M, F the events that student wears a tie, comes from East, come: TANI 
the Mid-West and comes from the Far-West, respectively. The given data now reads 
P(E) = 0.50, P(M) = 0.30, P(F) = 0.20 ; P(T | E) = 0.80, P(T | M) = 0.60, P(T | F) = 040 

P(T) = P(E) P(T | E) + P(M) P(T | M) + P(F) P(T | F) [Multi-stage p-Rule| 

= 0.5 x 0.8 + 0.3 x 0.6 + 0.2 x 0.4 = 0.66. 

We now utilize Baye's Reversal Rule to get 

P(E | T) = P(E) P(T | E)/P(T) = 0.8 x 0.5/(0.66) = 20/33. 

P(M | T) = P(M) Р(Т | M)/P(T) = 0.6 x 0.3/(0.66) = 3/11. 

P(F | T) = P(F) P(T | F)/P(T) = 0.4 x 0.2/(0.66) = 4/33. 
7*. Let C, (i = 1, 2, 3) denote the event of choosing the ith chest and R the event of 
getting red ball. Then, P(C) = £. P(RIC,) 20, P{RIC,) = 5, P{RIC,} = I. 
The ball obtained being red, the other ball can be red only if the chest is 3rd (C.) and 
thus, we require P{C, | R}. Now 

P(R) = P(C,) P(RV C) + P(C,) PIRI C) + P(C4) P(R ІС.) = T. [Multi-Stage p-Rule] 


P(C, 1 R) = Р(КІС,) P(C,)/ P{R} = 1.1/1 = 1 [Baye’s Reversal Кие] 


Remark. To find the probability that the other ball in the chest is black (B), we require 
P{B, |R}. 


[Multi-stage p-R 


uli 


P{B, | R} = Р(КІВ,) P(B,)/P{R} = 1/(1)=1. 

[You may call balls as gold coins, silver coins, etc. as some Authors do.] 
8*. Let S = Statement made ; 7 = Statement 5 is true, / = Statement 5 is false, 

C = А and B make same statement 5 ; D =A asserts 5 and B denies it. 
Then P(T) = P(F) = 4, Р(СІТ) = рр", (CIF) = qd, P(DIT) = др", РР = 
wherep + q = 1, p' +9 = 1. Now 

P(C) = P(T) P(C | T) + P(F) Р(СІР) = } (рр + qq). [Multi-stage p-Rule] 
^. (TI C) PCT) P(CITYP(C) = + Pp’ / + (pp' + qq') = pp' / (рр + qq'). [Baye's Reversal Rule! 
Further, РОО) = P(T) P(D |T) + P(F) PDF) = 1(рд + p'p. — [Multi-stage 7-R"* 
If A, denotes the event that A tells the truth, then by Baye's Reversal Rule 

P(A,1 D) = P(A,) P(D | A,)/P(D) = qp'Kpq' + gp’). 


9*, Let A, B, C denote the events of selecting these very boxes, W, the event of 
a white chip and W, the future event of drawing another white chip from the ит. 


are then having : 


| 


drawiné 
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BEEN o —. 
P(A) = = P(B) = ЕС) = 1. тэги, lA)z m P(W, 1.) 2, Р W, [uz 
4 
D P(W,) = P(A) P(W, IA) + P(B) P( W, | B) + P(C) P(W, ІО) = Hc an = i 2) = 1. [Multi-stage p-Rule] 


Further, P(W, | AW) = 0, P(W, І BW,) = 1, P(W, | CW,) = 1/3. 


[W, | BW, : means to draw white ball from B again] 


PO W) _ = P(A) P(WIA)(W,1AW) 1(1.092.14 2.1) 
- P(W,IW umi VV IU AW) 3X3: pedo RE A tit : 
‚ P(W,1Wi) P(W,) EP(A) POV 1 Аў E | = 1. [Baye's Rule] 


10*. Let R denote the event of choosing red ball. Then P(A) = 2/6, P(B) = 4/6, P{R | 
six} = P(R 1A) = 4/12. 


13 


P(R] = P(A) P(R| A) + PB) PCR | B) = 2.242 2-2 — [Multi-stage p-Rule] 


1 


E 
24 6 
P (61 R} = P{6} P(RIGJ/P(R]) = } +A (i 22 Is [Baye's Reversal Rule] 


11*. Let T, and T, denote the events that the transferred ball is white and transferred ball 
is black respectively. Let W denote the event that a white ball is extracted from B. Then, 


P(T,) = £, P(T,) = 2, PWIT,)= a PWIT,) = =. 
P(W) = P(T,) (WI T) + Р(Т,) Р(ИТТ,) = Z. [Multi-stage p-Rule] 


P{T, | W} = Р{У/1Т|} PIT P{W} = (3/(2)- 3..— Baye's Reversal Rule] 


12*. Let M, F, S denote the events that all n people chosen are male, female, and are 
of same the sex, respectively. Then, 


мн (e nm mins 


P(S) = P(M) P(S | М) + P(F) P(S | F) [Multi-stage p-Rule] 
“| 
- Qr ne (a X =") 
~ P(F | S) = P(S | F) . P(F)/P(S) [by Baye’s Reversal Rule] 
2 А 3n "lt", МА +( (*)|- $i (Independent-of n) 


13*, Let W, denote the event that i white balls and hence (4 — i) black balls are transferred, 


= 3 d А 
280.1 2 3 Thus P(W,) = (0652/0) 
Let w be the event that a white ball is taken out of second (originally empty) vessel. Then 


P(W,) = (3) /(8)- 3 P(W,) = (3)(7)/ (8)= =" 


A 
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ло пио" ОИ men 


2 E 
22 P(WIW;)= 1. P(W1W,) =9 


= і |W,)= 
P(W І.У) = 0, P(W | W) = L P(W 2 4 | 
0 kas -XPQV) PWIW) “0. E. 3,4 [Multi-stage P-Rule) 
| 3 mS 3 
s siu ЗО 15 -3 
7-29 t704 70 4 70 4 280 8 


5 3/3 = 1 В РЕ Е ; : lo} 
P(W,1W)} =P(W,) POW! WPW = 75:3/ 8 T [Baye's Reversal Rule) 
mily has one boy and a family has 
d we require P(C, 18, }. Now, 


So, 


14*. Let B, and C, denote the respective events that a fa 
k children. We are given : P(C,) = Pa [P(C, = Р], etc. an 


р TUE k-i 
P(B, | C,) = Prob. (a family with k children has just one boy} = (i)a p. 
P{B,} = P(C,) P(B, 1 C,) + P(C,) P(B, 1 С.) +... + P(C,) PG, 1 C,) [Multi-stage p-Rule] 


= En (fep o Exn a [P(B, 1 C) = p] 
k=! k=1 
So, P{C, | B,} = P{B, 1С, } P(C,)/P(B,) = P (ZKP; ay _ |. [Baye’s Reversal Rule] 
15*. Let R be the event that a red ball is selected from box B. Let R,, B,, M denote that 
transferred balls are both red, both blue or one-red and one-blue (mixed). Then 


P(R) = P(R,) P(R | R,) + Р(В,) P(R | Bj) + P(M) P(R | М). [Multi-stage p-Rule] 


Here Pæ = (ф/м. Pev. ro-(2(9/w.w -(5) -e 


P(R | R,) = 8/13, P(R | B5) = 6/13, P(R | M) = 7/13 
P(R) = (6 x 8 + 28 x 6 + 32 x 7)/66 x 13 = 220/429. [By (1)] 
(ii) L, = {atleast one red ball was transferred} = А, t А, 
P{L, |R} = PR, К) |R} = Р(К |R) + Р(К,1К) [Use Baye’s Resersal Rule) 


2 P(R) P(RIR,) , PIS) PCRIR,) _ (4/12) (7/13) (6/66)(8/13) 77 6 _ 10! 


P(R) P(R) 2201429 220/429 220 55 220 
16*. Define the events : E, = {even-numbered card from urn A) 
OB = {odd-numbered card from В}, E, = {ith card even}, O. = [ith card odd) 


P(E) = 5, PEy)-i. Р(О,)= $, P(0,) = +. 


эө ү 


(1) P(E, E.) = P(A) P(E,E, | A)) + P(B) P(E, E, | В) [Multi-stage p-Rule] 

=i 4 g44 2 3. ] 
S 15-2 *2:5- 17 E: P(E, E) = P(E,) P(E;! E 
(ii) P(O,O,) = P(A) P(O,0,1 A) + P(B) P(0,0, | B) [Multi-stage p-Rule] 


dux J 
"NT [> (0,0 = P(O,) FO; ^ 
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PIAVEE,] = P(A). EE, 1A) PEE, = (4) (5) 


=| + [Baye’s Reversal Law] 


17*. Let W, denote the event that i white (hence 4 — black) 


balls are transferred to second 
urn and W denote the event that ball 


from second urn is white (on the first draw). Now 
Awy = (°\( 5 mA Vitr s Е 

(W) (90.2009) -x (5,5) where a (9) - 210. 

P(W) = 5А, P(W,) = 502, P(W,) = 100A, P(W,) = 50А, P(W,) = 5А 


P(WIW,] 20, P(WIW,} = 4 PIWI W= 2, P(WIW,) = 2, P(WIW,} = 4. 


4 


P(W) =; P(W,) P(W | W), 0<i<4 [Multi-stage p-Rule] 
а dled 


Let W' denote the event that a second white ball is drawn from the second urn on the 
second trial. Then, 


3 
Now Baya’s Reversal law for the future event W’ is 
P(W' 1 W) = (Z, PW) P(WI W,) P(QW' | WW)/P(W) 


5 а ee Е о 2 
LI кш i gee Та агита 
Mum. = 315.0:0*5,.,4.0*51:5-3*5174137 42 9 
Since Den. = P(W) = +, hence P(W' | W) = $. 


Sec. 2.60. Page 95 


1*. Here, n(Q) = 36 are equiprobable possible pairs of outcomes each with prob. 1/36. 
Now, 
n(A) = ((1, 3, 5) х (1, 2, 3, 4, 5, 6] = 18 = [(1, 2.34523. 9) X(T, 9, 54] = nik 
To find n(C), we note that the sum of eyes is odd, if one die shows odd number and 
the other die shows even number ; so that 
n(C) = КІ, 3, 5) х (2, 4, 6) + (2, 4, 6) x (1, 3, 5)] = 18. 
Also, cases favourable to events A N B, A ПС, В П С are 
n(A NB) =[(1, 3, 5) x (1, 3, 5)] 29: ВПО = [Q, 4, 6) х (1,3, 5] = 9; 
n(C(1A) =R 3, 5) x (2, 4, 6)] = 9. 
NBN С = Ø (Since if two faces read odd, their sum cannot be odd). Hence n(ABC) = 0. 
us, 
P(A) = P(B) = P(C) = 18/36 = 1/2 ; P(AB) = P(BC) = P(CA) = 9/36 = 1/4 ; (ABC) = 0. 
- РАВ) = P(A) P(B), РВС) = P(B) P(C) ; P(CA) = P(C) P(A) ; P(ABC) + P(A) P(B) P(C). 
lt follows that the events are pair-wise independent but not mutually independent. 
Serve that 
AB = {(1 1), (1, 3), (1, 5), (3, 1), (3, 3), (3, 5), (5, 1), (5, 3), (5, 5) 
BC = [00 1), (4, 1), (6, D. (2, 3). (4, 3), (6, 3), (2, 5). (4, 5), (6, 5) 
= {(1, 2), (1, 4), (1, 6), (3, 2). (3, 4), (3, 6), (5, 2), (5. 4), (5, 6)}. 


p 
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2*. Let D denote the event that 2-headed (dishonest) coin is selected and H denote 
the event that a head turns up when the coin is tossed. Then P(D) = P(D)= L Note 


that, if coin is 2-headed, H is certain to occur, but if the coin is fair, H occurs With 


probability 1/2. Hence, P(H | D) = 1 and P(HID)- 1. Now, 


P(H) = P(D) F(HID) P(D) P(HID) 2 1.1« 1.27 3. [Multi-stage p-Rule] 
P(D).P(H\D) (3)(D 2 | 
P(DIH)- : = = Baye’s Reversal Rule 
ex P(H) а id А 
3%. Chances of the animal being shot dead at the successive ranges аге d PAM (1/3) 
aab s (1/n)*. The corresponding chances of the animal's escape are 


[OS Petre 36043571 = (Umy 
Thus, the chance of escape of the animal at the end (r = na) (by Product Rule) is, 


1 1 1 1 n 1 
r= (BBS (BAB 
| ZA 3“ 4° n? П x 
s [1 x-1 pau 3) eas 5 E чый 
ау dr. ШӨ ДОМО V4 a -A On” -n 2n ' 
S d ШЫЛ! і NM 
о 4 = 1-р=1- =——. (Chance of animal being killed) 
2n 2n 


Thus the Odds against the Sportsman are p:q=n+1:n-—1. 
4*, Let p = +. Obviously, B wins in three more games with probability (1) =p. 


P(B wins 4th game) = [3p + 3p 1/3, P(B wins 5th game) = [6p* E 12p^y3, 
P(B wins 6th game) = 30р?/3. Thus P(B wins) = 55/243 (Total probability). 


Chapter 3 : One-Variate Distribution Theory 


Sec. 3-21. Page 119 —— 


1*. We know that a c.d.f. has to be non-negative. Now if 0 < x < 1, then In x< 0, this 
necessitates that k be negative. Also if 1 < x « 3, then In x > 0 and this does require tha! 
k be positive. It means there is no constant k which would make k In x > 0 for all x 1n 
the interval ] 0, 3 [. Thus, F cannot represent a c.d.f. for any non-zero constant k. 


к= 0, then F is а c.d.f. 
2* (D If X «a, then (X Sa) e Q,^ > P(X кш = P(S) e»-F(x) = 0. 
If X » b, then (Xsa) =O, => PCS) Р) > Faye Р, 
(ii) If Y(o) € t, then X(@) < t, since X(@) < Y(o). 
(Yxt) c (Xst) >P(Ys)SP(XSD) > Еу) < FO. 
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——— Sec. 3-32. Page 122 


1*. Here X is discrete and P(X = x] = k(x + 1) (1/5). Since Lp(x) 1, x > Ма 
get, putting 1/5 = r. 


JekE (xD) CHK 14+ 2r 6 32 Ar H...) I kl - r) k (25/16) => k = 16/25 
(16/25) (x + 1) (1/5)", x = 0, 1, 2, 


p(x) 


3 6 
— + 
> 3 


P(X<5) = PX =0)+ P(X = 1) +... + P(X = 5) = EE 


= 0.64 (1 + 0.4 + 0.12 + 0.032 + 0.008 + 0.00192) = 0.64 x 1.562 = 0.9997 
Note. Since F(5) = 0.9997, it follows that, for X > 5, F(x) will change very slowly 
2*. We find c.d.f. of X. Thus, since F(x) = P(X < x) 


b ЗН (x +1) (x +2) 
"T (n + 1) (n + 1) 2. rU» (n + 1) (п + 2) TAM 
Thus, P(A) = Р(Х € m) = (m + 1) (m + 2)/(n + 1) (n + 2). Mi 


An appropriate model conditioned on event A for x є A, is 
P{X 1 A} = P(X, AVP(A) = p(x)/P(A) = 2 (x + 1)/(m + 1) (т + 2), x = 0, 1, 2, ..., m. 
P{B\A} = Р(ВПА)/Р(А) = Р(В)/Р(А) = F(D/F(m)- (0+ 1) (0+ 2)/(m + 1) (m + 2). [`` BCA] 
3*. The sample space, random values and probabilities are as follows : 
Q : {(hhh), (hht), (hth), (thh), (htt), (tht), (tth), (ttt)} 


Кес 3 2 2 2 1 1 | 0 
р: x 7 E 27 E $ à E 
Ех) = Р(Х < x}, so we get 


0, ED 
727, 0545) 
7/237 TSFR 

19/27, 28 x «3 

I 3€ x 
The circle on the graph are used to 
indicate the right-continuity of the 
function F(x). 
4*. Let X denote the number of senior teachers amongst the three members chosen, 
then О = {(x,, x5, x,) : x, = 1 or 0). Here X, are indicators and X = X, + X, + X, and range of 
X is (0, 1, 2, 3}, so that X is a discrete variate, Now 

P{(0, 0, 0)) = (0.6) = 0.216 ; P((1, 0, 0) 
= (0.4) (0.6) = 0.144, etc. 
p(0) = Р(Х = 0) = P0, 0, 0) = 0.216 


P(X < x) 
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0.1.0), (0, y = F(x) 


p) = P(X = 1) = P{(1, 0, 0), (0, 1, 0), (0, 0, 1)) 
= 3x 0.144 = 0.432 

p(2) = P(X = 2) = P{C, 1, 0), (1,0, 1), (0, 1, 1)} — 9,936 
= 3 x (0.4)? (0.6) = 0.288 

p(3) = P(X = 3) = P(C1, 1, 1)) = (0.4) = 0.064 

The distribution function F,(x) = P(X < x) is 

F(x) = 0 I (x < 0) + 0.216 I(x < 0) + 0.648 

Ix € 1) + 0.936 Дх < 2) + 1 1 (x < 3). 

5*. О = (Q0, x5 x) 3%) = 152 ss bp fm e de) 


0.648 


0.216 


-1 


P(integerisk) = + =p; 


P (integer is not k} = 2 = q. 


Range of X = (-1, 1, 2, 3] 
P(X 2-1) = 4 = 125/216 ; 
P(X = 1) = 3pq? = 75/216 
P(X = 2) = 3p’q = 15/216 ; 
P(X = 3) = p! = 1/216. 
Note that X = 2 means (k, k, 0) -2 
tt (k, 0, к) € (0, k, k), etc. Thus, 
125/216 for x--1 
75/216 for x=1 
ne soe fap ee Ж 
1/216 for x=32 
The distribution function is F(x) = P(X < x). Now 


Ww — eee – 


0 x«-—] 
125/216 х<-1 
Fx) = 1200/216 xxl 
215/218 X2 
1 Е 
Evaluation of probabilities : 
(a) P(0 < X < 3) = F(3) - F(O) = 1 - (125/216) = 91/216). 
(b) P(X < 0) = F(0) = 125/216. 
(c) P(-1 < X < 0) = РО) – F(-1) = (125/216) - (125/216) = 0. 


6*. We require to evaluate X (e^ *^— 1). 
Let A, = (a, b : (a, b) = 1). Then, putting m = a +b 
58 (e^ ** » py" = foc" a у? - fe Re" же Ew eae 2.2 


=m -2m -3т - = & 
У ле + ле эт У ле +. Ж У ле т + де 2т " У е 3m TA 
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EE uu b: (a,b) =n). T ' sum ca | | 
н: En oe і iyd the sum can be replaced by X, e ", where A 1% 
; - TEY as suc > set of 
given by | uch A is the set of all positive integers. Thus, 


А а. D | e 


а= | һ= | 


Observe that the series involved are absolutely convergent so that the double sum has 
been expressed as a repeated sum. Іп, К е". ly = 125 Ке (е 1) 
Now K=1&a=b, (a, b)=] &a=b= 1. Hence 
" A^ - 2 - ә ј 
P(X 21) =К(е – 1)" = (е Pe - 1) = (e туе + 1). 
1 P(X < 1) = Ey P(X = alb), B = (a, b : (a, b) = 1, a < b]. 
E P(X > 1) = Ec P(X = alb), C = (a, b : (a,b) = 1, a > b]. 
— Since B = C, it follows that Р(Х < 1) = P(X > 1) = p (say). Now, 
P(X <1) + P(X= 1) + P(X> 1) =1 > 2p=1 -(e- 1)(e + 1) = We + 1) => p=P(X< D) = Ue * 1) 


ww , 


PX < 1) = P(X < 1) + P(X = 1) = [1/(е 0] + (Ce — De + 0] = ee + 1). 


E. Sec. 3-55. Page 131 ct ————MPÁá—— 


p 


v 


i 2 The distribution function F is not differentiable at the sharp edges : x = 0, x = 1. 
Except for these points, F is differentiable everywhere. Differentiating F we get 

E ПО) =0,x<0,orx>1;f@=1,0<x< I. 

it x = 0, 1 we are free to choose f(0), f(1) arbitrarily. Let us choose f(0) = f(1) = 1, and 
us we obtain | 
f(x) =1,0 <x < 1; Дх) = 0, elsewhere. 
P(4 <Х<2) = Е(2) – Ез) = 1-4 = 5. 


5х1) = (2) - 1) = 1-3=%- 
ig density function f we get 
P(isX«3) = |2 fœ@dr= fin dx- 3-170 


T a3 

P(isx«2) g E f(x)dx =f, Idx =, 

ne c.d f. “Р” is not differentiable at x = 0, x = 5, x = 3 (sharp edges) and except 
ints, f is differentiable everywhere. Differentiating F we get 


[fix) = 0, when x > 1]. 


eee j" - 40, x<Oorx>3 
ИОК" Ax) 512. 0«x«j 
m л 68-3)25 i«x«3 


4 2 


Ba) ; М A to choose f (0), f (12.3) arbitrarily. Let us choose f (0) = 0, f ( LET 


TOWER 


ТИНИ. 1,27. 213 
у= рт х0 = | 2x dx + fi. 55 3-0 = 3 * 100 10 25 
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where we have used f(x) = 0 for x < 0 ; and have split the range. 


(ii) p(4 <Xx<4) = E f(x) dx = ж 1 Qx) dx f, 3 G- х= 5 


3 215 
(i) Р(-1 < X < 1) = F(1) - F(-1) = f1- 20-0" |-0= 5 


(ii) (4 < X < 4) = F(4)-F(4)=1-()= T 


3*. Obviously F is discontinuous at x = 0, 2, 3. Hence 


Е(0)— F(0 —0) - 1, at x -0 
p(x) = FQ)- F2-0)2i-i-1. at x 22 
F3)- F(3-0)21-$-1, atx=3 


That is, p(0) = 4, р(2) = 1, p(3) = 1. Here X is discrete and p(0) + p(2) + p(3) = 1. 


4*. Since X is continuous, F has no jump-discontinuities. As usual 
P(a € X < b) = F(b) - F(a) = 0.7 - (0.5) = 0.2; P(b < X < с) = F(c) - F(b) = 0.8 – 0.7 = 0.1 
Р(— © < X, <a) = F(a) = 0.5 P(c < X, «o)- 1 ~ Fic) = 1 0.8 = 0.2. 

Since X, and X, are independent variates, so P(X, є A, X, є B) = P(X, € А). Р(Х, є B) 
P{-0 < X, <a, с<Х, < о) = Р(-0<Х,<а). P(c < X, < ©) = 0.10. 

5°, Кх) >20 => (1-х) 2 0 2 x(1 - x) 2 0 since k > 0. 

This gives x > 0, x < 1 ; x < 0, x > I. The latter result is inadmissible by (1). Hence 

0<a< х <b < 1. To determine the normalization constant К, we have 


1 = k (x - xy dx=} ЗЬ? - a^) - Xb’ а?) 
Thus, k =6/(b — a). [3(b + a) – 2(a^ + ab + b^)]. 


6". Fo) = [оа + p)roa - proa 


^ 2 
Fix) = f gaa 0<xs 


13.5 1 
ol patel Shae m y 
Ro = 54+] gia 5 ie) pu^ 
For x > 4, F(x) = 1. Thus, F(x) may be expressed as : 
0, —o<x<0 
2 
F(x) M x^/6, и О<х<1 
(13/27) + 5(4х – 1x W27, t<x<4 
La x24 


F(3) 2 13/27) + (5/27) [12 — (9/2)] = 49/54. 
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p [food fre ax =k TD, 


where “fp E 2 the fact that the integrand is even in the range ] —», » [ and 
replace бен е pen x € [0, v [. Trivially, we observe that fœ) 20 Yx ej], о [. 
Thus, f is certainly a density function and X with this density is called “Laplace distribution.” 


F(x) = 1% f (t) dt = ге ШР 


(i) When x € 0, [ x = -y, y > 0] we have 


om dp > -kirl pi 05 €. =й . 
F(x) = зк] e dt=1k | e "а= e"dt-le -ie". 
-— Р ЫН 2 2 


(ii) When x > 0, we have 


Fo) = 10] e" des pet at)=1- he 


8*. Here F(x) = P(X <x) = | 100 it =1- 1". 
;? 


If p is the probability that a tube lasts for first 150 hours, then 

p = P(X < 150) = F(150) = 1 - (100/150) = 1/3. 
Hence, the probability | that none of three such tubes is to be replaced during the first 
150 hours is p.p.p = p°, 1/27 [by independence of tube's lives]. 


Since q = 1 — p = 2, the probability that all three tubes are burnt out (i.e. have to be 


replaced) is 4.4.4. = 5 [again by independence]. 
9*. Firstly, we find distribution function of X. Thus 
Sit F) 


sie dcin - | 
F(x) = PX«x)-0| 007 jac ten 
(a) 2. P(X za} = 1- Fla) = 1/(1 + a). 


Thus shows that as Ө increases, 1/(1 + а) decreases ; so Ө is a sensible m.h. of wood. 


(b) PX s 1) 2 0.99 => 1-01) 20.99, ie 2° 50:01, 


‚ in, 2 «-20n 10 => Ө z 2/ln,, 2 = 6.6438561. 
Thus any value of 0 2 6.64 ensures ә бмр. 
(c) p - = P{l =X s 2} = FQ)- FK) = DE oF [by (1)] 


2 2 
p’=3% tn, 3-2 I, 2p" = 2? (n 2) - _ 37! (ln 3)^. [p' = dp/d0, р" = 4 p/d9 1 
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(1) 


р 20 => (3/2) = (în 3/ 2) = L say 


a = (Un L)/in (3/2) = Op, say 
So р” (Ө) = (379 (п 3)/(0n 2/3) < 0. [by (1)]. Hence p is maximum for 0 given by | 


Sec. 3-73. Page 141 ———M 


TM 


s 
^ 
e) 


1*. F(y) = P(Yxy) = P(! XI s y) = P(-y < X < y} = P(-y < X < y) U (X =-y)} 

= P(-y < X € y) + P(X =-y) = Еу) - Fy(-y) + Р(Х =-y) (Dist. Properties) 
Obviously, Fy) = 0, if y < 0. 

F(z) = PY <z} = P(Y < 22) = Fle). [Obviously, F(z’) = 0, if z < 0)] 
Now use first part to get 

Едо) =F- FA) + P(X =-2") ; Едо) = 0, if z < 0. 

Exercise. Find the density of Y = | X | when X is (a) N (p, o^), (b) Lap (A, a) (c) Chy 
(a, b). 
2*. Let Y = е^, and use transformation y = e, i.e. x = — (n y. 
This gives | dx/dy 1 = у; x 2 1 — y x (lle). 
Further у > 0 (obviously). From fy(x) = | dy/dx | fy) we readly get 

fy) = [у (фп yl, oys e, fy) = 0, elsewhere. 
3*. Let y = tan! x > x = tan y so that dx/dy = sec? y » 0. 
Thus the function is increasing. Also 1 + x! = 1 + tan? v= sec? y. Hence 


x sec? y А, а Мм» 
i. с a AE 


dx ||- 
dy n sec? у 


fy) = E (x) 


Sec. 3-80. Page 143 


1*. The area of the triangle with length a is A = 1a sin(n/3) = a^ [3 . Since the area 


under a probability curve is unity, we get 1 = а |2 ога = 2(3) ^. 

2*. Since -1 < sin (лХ/2) < 1, the only possible values of Y аге -1, 0, 1. So 
[= 0} = (X221,n21,2,3, .], {Y= 1] © {X=4n+ 1,n=0, 1, 2,...) 
[Y 2-1) € (X =4n+3,n=0, 1, 2, ...] 


ob о new © үү" 24 | 
= = P(X =2a)= 1) == 1) = 5 ===; 
PY = 0) = Y, P(X=2n)= 2 (5 22, ^12 53 
ч Ed SE ae І 8 
Р(Ү= 1) = У P(X =4п+1) = (2) = = Gc) = — —_____ =. 
2, 4 2 2 22. (16) ^81-Q716) 15 


n=0 


о РА i ni 1 d i n 1 | 2 
Р(Ү=-1)= V Р(Х=4п+3)= (1] a (5) T d e „=. 
2, 2, 2 3 2, (16 81-(/16) 15 
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3*. Let y = Sin х; then dy/dx = cos x = Jı Жы? д = Ji * y? . Further 
X = + 1/2 5 у= + |. 


[ | hae ы ашу 
n /1—у 


4*. Let y = е", then x = (п y, (dx/dy) = lly>0, [x20 ymljx-l-ysze 
FAY) = (f(x) l dxidy 1) = у, 1<у<е. 


Chapter 4 : Jointly Distributed Random Variables 


fon йу dy 


— Sec. 4-12. Page 153 ee da CON 
1*, Recall p(x, y) = F(x, у) + F(x", y ) - Fx, y) - FG y) 

where p(x, y) = P(X = x, Y = y). Now 

p-2, 5) = F(-2,-5)- F(-27,-5-) - F(-2:,-5)- F(-2,-5)21«0-0-0-1 
p(-2, 3)  F(-2,3) + F(-2,,3)- F(-2* ,3)- F(-2,3 )29 $4 0-1-0-41 


ОЕ n5FQ,-5)-FQ'.,-5-FQ,-5)-1-0-0-1-1 


2*. Formally : G(x, оо) = 1 - e^" х> 0; С(о, у) = 0 or 5 or 1, according as y <0, or 0 < 
y« 1 or y > 1. These are well-known distribution properties. Now, by the Rectangle Rule : 
p-2P(a«Xsb;c«Ysd)-F(b, d) + F(a, c) – Fla, d) ~ F(b, c). 


To eliminate exponentials, take a = (n 4, b = п 6, с = 4, d= 1 ; then 


| | | | | byt =] 
PiS зе 4 \ aes 144 <°: 
It follows that G(x, y) cannot be a c.d f. 


Remark. Construction of bivariate c.d.f. is more complicated than its computation. 


3*. The required probability p is given by 
Peres = 2.1 < Y <2) = (2, 2).%+ FU, 1) = Al, 2) — FQ, 1) 


= l(1-a* Edi eiui ^ ee 3 „сыл tl a cq )›-@ hese +a) 
„ые „АРЫЛ. КЫ. ныг 
4*. Let F(x, y) = 1—e* =e 4 04.50, у> 0, М = тах (х, у) ...(1) 


Let y -> о ; then e? > 0, e£"? > O and so F(x) 21- e", x20. 
Let x > oo ; then e* > 0,е “?-э 0 and so Еу) = 1 =f, ye 0. 
Now consider: G(x, y) 21 -e"^ — e” + (е +e – nH8 ixyzO. (2) 
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Let y > о, then e? — 0,(е + eg-1y'-—0,andso G,(x)21-e", x2 0 

Let x > ©, then e* — 0, (е + е - 1)" — 0, and soGfhy)=1-e’, у»>0 
Thus, although F(x, у) + G(x, у) ; Сух) = Fy(x) and Суу) = F fy) 

Note. F(x, у) = 0 and G(x, y) = 0 for x, y < 0. Such values are always understood (imr 


Sec. 4-31. Page 158 —————— 


1*. Let Y be the number on the second die D,, then 5 = X + Y so Y= 5 - X. Noy 
independent of outcomes on D, and D,. 

P(X =j, S-kzP(X-jY-k-j-P(X-jP(Y-k-p- 1/36, [1 <j <6,2<k< 12 
Here 1 <j<k<12;1<k-j<6. If these inequalities don't hold, f(j, k) = P(Z) = 0. Nos 
for outcomes on D, Р(Х = j) = 1/6, 1 <j < 6. 


6 
P(S =k) = 2. Р(Х = ј, 5 =k). 


Іп this sum, the non-zero terms, each 1/36, are those for which either 1 <j < k < 6 or 
1<k-—6<j < 6. Hence 


поса {ERAS ERE ia npe T 
Remark. Tabulation of outcomes yields P(S = k) visually and convincingly. See Chapter | 
2*. The 2-dice experiment yields the joint p.m.f. which is shown in $1-42. Thus, (р = 1/56 

f(x у) =p,ifl<x=y<6, f(x, у) = 2р, 1 <х<у<6. 
Р) = 0у- 1р. 1 <у<6 ХО) = (13-2х№р, 1<х<6 
Лук! у) = ЛО, yf) 


YR 1/(2y-1), if y=x 
This gives, fio ly) = and if ae 2,...,¥—1. 


Note. For tetrahedral dice, | € x, y < 4, note that 


1/(9-2x), if x= 
f(x) = 9-2x)p, LUA w 23, HEEL 


3*. There are the following numbers of cards in the deck : 


Spade-Ace (SA) = 1, Non-Spade Aces (NSA) = 3; Spade-non-Aces (SNA) = [2 


Ы in (52) = 1326 =K “7 
NSNA = 36. Now two cards ош of 52 cards can be selected in үч = 13 


We layout the plan for calculating the favourable cases as under. 


P(X»Y) = (108k + 3k + 3k) = 114k = 114/1326. [E = 1/1326] 
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Values 2 
l 36 Favourable cases 


/ 


(x, y) SNA NSNA 


4*. By normality Ур, = 64a = 1 => 1/64. The marginal p.m.f's of X and Y are the row 
and column totals of the given bivariate tabular distribution; thus 


0 
1 
2 


| 


. Р(Х 20) = 16a, P(X = 1) = 40a, P(X = 2) = 8a ; 
PY = 1) = ба, P(Y = 2) = ба, P(Y = 3) = Па, P(Y = 4) = 13a, P(Y = 5) = 12a, P(Y = 6) = 16a. 
(i) P(X < 1) = P(X = 0) + P(X = 1) = 56a = 56/64 
(i) X < 11 Y=2) =P{X< 1, Y 2 2}/P(Y = 2) 

PX <1, Y= =P(X=0, Y =2) + P(X=1, Y=2)=0+4a; Р(Х < 11 Y 2) = dalóa = 2/5. 
(i) ^ PX<31Y<4) = P(X «3, Y «4)yPC(Y < 4). 
Now P(Y < 4) = P(Y= 1) + Р(Ү = 2)... + P(Y = 4) = 6a + ба + Па + 13a = 36a. 
P(X <3, Y <4) = P(X=0, < 4) + Р(Х = 1, У<4) + Р(Х = 2, 5 4) 
= ба + (Да + 4a + 8а + 8a) + (2a + 2a + a + а) = 362. 
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P(X <31Y<s4)= 36a/36a = 1. 
5*. For the convenience of tabulations we draw joint p.d.f. table taking a = 0.01 = 1/100 


Total 


Pog 


X+Y 1 ? 3 4 5 6 y- 5 
Prob: . 2a 5a 14a 19a 26a 2la 10a 3a 
NE: 0 1 2 3 йд, 95 6 8 9 IU A 15 
Prob. 7% 20a. a Exc Ол nae 22a 8a 12a 4a ба За 
EN SS ЗИ ОЕ 
EB 25 de 4a» 10d За. 16а ба 21а ба 4a За 


6*. Let P(X = 1) =a, P(Y = 1) = b. This immediately provides the marginal totals, 0.8 - b 
and 0.8 — a. Since X and Y are independent, 


PX к= r= POH РОУ =P) > ab = 0.06; 

РОС sere a= i = 3) РОУ = 3) => (0.8 – b) (0.8 = a); = 0.3. 
Eliminating b, these equations provide : a^ — 0.5а + 0.06 = 0 = (a – 0.2)(a - 0.3). 
When a = 0.2, b = 0.3 ; when a = 0.3, b = 0.2. 

Since marginal totals are known, cell entries are immediately obtainable, by multiplying 
the row total into column totals. The results are entered in (R.H.S.) table shown in the 
problem for the case a = 0.2 and b = 0.3. 

7*, Let the first head occur on trial m and the second head occur on trial n, then їп” 
trials two heads and n - 2 tails have occurred, so 


D UH pe PERS 
PO труе nog „ера ont Pl Sonam 2, 3, .. NU 
0, . elsewhere p+q=l 
By Multi-stage Rule, we get 
Р(Х=т)= УР(Х=тҮ= ј)= р! Ye 4 = р! + pq" (2) 
j=m+1 j=m+1 1—4 


n-li 
Р(Ү=п) = Y P(X =i,Y 2n)» (n- 1) pq". 
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А P(X =m! Y 2n) z Р(Х = m, Y = nyP(Y = п) = (n TN | a (4) 
Thus, if it is known that the second heads occur at the nth trial, the first head must have 
occurred during the first (n — 1) trials. Clearly, 


all these possibilities are equally likely. Now, 
py e nl X =m) = Р(Х = m, Y = nyP(X 


n-m-— 1 


= т) = pq (5) 


P(Y -X-k X= - k \ 
ЕХЕ Хет) = ————_* en) fFP(X-mY-m*k _ , 
М Р(Х =т) , Р(Х=т) =pq [by (5)) ...(6) 


We see from (6), that s K iS independent of X. Further (2) and (6) reveal that Y — X 
and X have the same distribution. 


8*. The marginal densities are 
ДО) 


f(x) = (1/27) E, (х+2у) = (1/9) (14 2y), у= 0,1,2. 
The conditional distribution of Y for X = x, is 


(1/27) , (x + 2y) = (1/9) (x + 2), x =0, 1,2. 


fyi (Y lxo) = f(x, у) (х) = (х  2y)/ (3x + 6). 


fiy|x=0) = 1 folz): =, and foir=) 2. 
These provides the various values 
RY =01X a0) =0, AYz1IXz0241, ДҮ=21Х=0)=1 
fY=01X=1)= i, RYs1IXz1241, fY=21X=1)= ё, 
ҚҮ=01Х= 2) = І, Кїє11Х=2 = AY =21X=2)= 1. 
—_—_———————— Sec. 4-44. Page 168 —— 


1*, (i) Let g(x, y) = f(x) Ду), since X, Y are i.i.d. Now 


PX « Y) = [` dy fe) fO) dx - | FOFO) - FC dy, 
= [irdt=5. (t= FO), ЛУ) dy = di, Fx) = 0, К) = 1] 
(ii) Let h(x, y, z) = Дх) Ду) Az), since X, Y, 2 are i.i.d. Now 
рх<ү<7) = |" f(odx fi, Хо) ах | 70) dy 


[`4 [„ ТОЛЕ) - Роа, [Put FC) = и] 


[FOIE = 5 FOI а, [fco = К) 


1 tr» wT н 4 VE 
a a F'(2f(075 „^ 4 gi 


arred Problems 


и ES LL — — — 


P(X>Y,X>Z)_ P(XemaxQGY.20 3.2 
VAL. PLI FXSE S (o0 X2 | 3 
n P(X>Y,X<Z)_P(Z>X>¥Y)_3'_ 1 
a) i "wie ee) ЖЕ, 
мі / Р(Х>Ү,Ү>7)_Р(Х>Ү>7)_%!_2 
E nu EID. POS УМАИ ИЕ 

P(X»Y,Y«Z) PY =min (X,Y,Z) 3 2 
ч i-i 
2 


(iv) "M" peed). P <Z) 


Note that P(Y « Z) = P(Y > Z) = + (by symmetry), P(X = Y) = 0, etc. 
3*. Since f(x, y) = (х). (у). А0) = Ae". х> 0 Љо) = re”, y > 0, it follows that X and 


Y are independent Expo-variates. 


(a) P(X < k) = PO<xsk=f, Xe" dx=1-e™. 
(b) P(X > kY) = k dx [> fa.» dye | d dy |, ig" а= | yt! - 


r(1) 1 


= Reis 


—A(1+k)y dy 


| 
Note by symmetry : P(X > Y) = P(X<Y)= I [P(X S Y) + Р(Х <) = 7. 


(c) P((X/IY <k} =P{X< kY} = 1 - P(X» kY) 21 - 1(1 + К) = K(1 K). — [by (6)] 
Note. If X/Y = Z, then ЕДЮ) = kI +k), (о) = Е) = (1+ 20) 2, 0«z«o. 


(d) Р(Х< YIX < 2Y) = Р(Х < Y, X «2YJP(X « 2Y) = Р(Х < ҮУР(Х < 2Y) = 2. [k= 1,2, іп(0) 


(e) Put x + y = и, y = uv, so that dx dy = | J | du dv ; 
(i fee y 2 e320; ye 0) > Pil<a<2, Ce v <1} 


P(LI4«X4Y«2) = [Ез eM de dy- | dv. f? XJ ue™ du 
1 
= [(+awe™], =[4+2)-(1-20) ee 
P(0<X+Y<1} = рар X ue" аа = |+) е) елж)" 
(f) р= Р(Х + У<т) = РО <Х+У<т) = [| du |" печи =|а+0) е 101+) 


When p = 1, this gives e" = 2(m + 1), with approximate evaluation т = 1.7. 


(g) Since X and Y are indep. P(O < X< 11Y22) = 0€ X € 1у = 1 - e^. [by (a) with k= !! 
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20. ü is given that y ranges from 0 to х. In 
. it is k > 0 and use normalization rris the upper limit of x, we 


= ло, y) dx dy = 2p dx f dy - 0 
Д = 1 provid = 
0, provides К = |. Thus, 0 < Y €x < 1. Now we find marginal densities. 


Лх) 


ауф = [24y =2х,0<х<\ 


= | 
Љо) i. fo у) а= | 2dx = 2(1- y), 0<у<1. 
(0.50) # fix, y), X and Y are not independent. We now find Conditional Density 


1 
165 09421,1 0& yeu. 


Ё $: 
b k Dole FO) dol 


A Ej OLY <x <1, 


Pe Лубу) = ne 


eri x= 2}-P{X>51Y -1) 
determine k by normalization P(Q) = 1. By Even-Odd integrand properties 


Аи за. 


E of odd-even integrands are utilized. 
E {чи PP ac 
=), 05952... уз 
nra | axe 4 
р" TERS: A ét 1) ХА 

hl steh t pur posue: dije: 


dx ооду "ELT OUS eo 0 i 
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Fy(x) 4 [ Je ЕР dy As 2e “(1 - e") = y e - ^ and 0 < x < oo. 


- Sy) € 2. edi 
Јолу) En fh) phy mA. .y«x«0o. 
f(x, TH v Sail cd е? 
Дух) S — Ot y x 


[at ау, 4-1) ee) 


P(Y 2 3) €T Љо) dy-2[ e? ду=е%. 
Since f(x, у) * f,(x) уу), it follows that X and Y are not independent. 


РАГУ) f f a -x-y)dedy 


| - ih ae sedis sl G Jar=3. 
x | dx 


l 5 
“Perea а 
керез an: 


3-x ] 


P(X+¥<3)= [dxf `(6-х-у)ау=ь +f, d -8х eT) dee. 
Marginal Distributions and Conditional Distributions : 


ло) = f g6-x-dr7 40-3. 0«x«2:/()-0, «0 or x22. 


1 
fh) = f, ¢@-2-ydr=76-y), 2«y«4; f,(y)=0, otherwise 


fxly- poris: 2<y<4, Ox. 


RO 25-»' 


— Py .16-x- 
Bret e Xi 


8*. We determine k by normalization P(S) = 1. Now 


суса <=? 


ло) = ffe ode Sep 
= Ske (1-2°),0<x<1. 


So 1 = fi f(adr= n(1- : sym 


Thus, ЛО) -4x«1-x) O<x<1. 
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Лу) = [ f(x, y) dx yx] 4 у?, 0. 
0 
f (x | y) ы У (А, ^? M _ 8ху T 2x 
f) ау) | y у 


Х=й<у 


(ii) 


РО, у) 8xy 2y 
іх) = = ———— = | 
hO )= Р(х) Ax(1 — x?) poA сус 0«xzL 
Since f (x, y) + fx) fy), X and Y аге not independent. This also follows trivially 
because the effective record space is not rectangular. 
(ii) For distribution functions, we consider the various situations : 
We require P(X < u, Y < v) and hence the various cases of the positions of lines x = u 


and y = v. See above Fig. 


0 - u«O0;v«O (Space Ø) 
ae. 8xy dx dy, и> v,0<v <1, Fig. (i) 


EL y). Г. F 8xydxdy, v2u,0<v<l, Fig. (ii) 
T da 8xy dx dy, V 2u, 0<и<1, Fig. (iii) 


1, uzvzlor v2u2l, (Space €2) 


Evaluating the above integrals, we get 


0, u « 0, v«0 
pe u2 v, 0xvxl 
4 У 
Е(и, v) = ?ц2у2 и“, Vu, O<svsl 
ди? — u*, vu, О <и<1 
1 uzvzlor v2auzl. 
, 


idly B uw ., ol 

a =Í, 4y dy = 556 

| хи)" f no p dx dye 8[, * dy [хакер . [Draw Fig.] 
+ (20 Jx=0 Y 


үк) 1/256. 
Кл. i P(X <3 Y <a) = 1; 
м z Y< )- Fiera) 71/256 


0 


| | | 
C087 mx + у) | 


1 
9*, (a) мо) = f, f. »dy- f ЧЕ TP | "v | 


1 afcost ax +sind meh 0<x<l. 

* | А i E ) : 
By symmetry of f(x, y) we observe that, f(y) = Ix c0s( 5 E sin| > TY J| О <у< | 
Since fix, y) # fy(x) fy) ; X and Y аге not A. although the Record Space is а 
rectangular region: 0€ x < 1, 0€ у < I. 


(c) P(v«1x)- [ap з 8a -5[ [ex ()-e (5-07) 


о 1 , m 
10*. $ Jue mm Y dd -. [by Differentiation] wit 
0*. Recall 2z 1410; z TE [by 
Ww: Sw y)-fi(x) fV) = qx(py) ',х = i 25 3, 4., Os ys 1 (Joint density) gh?) 
The unconditional density of Y, say g(y), is obtained from (2) by summing out x 
(у) = f(x, y=GDx(py)" = : > [by (1) 5]. 0<у<1, t3) 
xz] х=] (1 — py) 
х - 2 
So fx(x | у) = Дх, у)/8(у) = ру‘ .(1-ру),0<у<1, х= 1, 2,.. ...(4) 
А 1 1 5m ; 
(i) PY > 11Х= 0 = | ОХЕ Odys |, ky" dy-1- CD. 
(ii) Р{Х= КУ ot} = P(Xzk Y « pIP(Y< 5) 2.5) 
Now, p(y < т) = [| aü- py)? == "s 


| 1/2 4 TOR RN 
Ке) = ка|, (py)! dy = ар! (2) | КО = kin Eq. ол 


Substituting these values into (5) we get, PX = ХІҮ « + 1} =(2-p) p' E (iy. 


11*. The sample space is exhibited in the diagram. 
We find the joint p.d.f. and marginal density of Y. 
Ах, y) = fly |) ЛО) = [2У/(1 - x°] [8101 — 397/26] 
= (81/13) у, O«y «1-x, 0«x« 2. 


2/3 ( 8] | 
* (51), dx, суя 


fk») = 
£] (SB) vas IET 
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(13) | 
fo) ^ 13 У, ерее 


81 
(8)5a- y, 2 <у<1 


he conditional density of X given y = y, ke. g(x | y) = fix, yf y) is given by 


(S2)/ 54у 3 1 2 
13 J/\ 13.) 7 Casa. USES Wo 


81y 81y(1- 
(т) 2%». (1-у)'!, ash 0«x«1- y ...(ii) 


А т 
‘Y= 30 min = 5 hr, we get from (ii), 8(х12)= 2,0<х<1. 


Х< nm PS Akal |: д1, ) 
T „ 4dx J y 15 тіп. = hr. 


— min. — ($ ) hr, then the event of leaving bed later than 6.20 a.m., i.e. (X 2 +} 


g(xly)= 


e, because x > 1 „у= $ givesx* yz 2 > 1. Hence Р(Х 2 1) = 0. 


Sec. 4-55. Page 178 


convolution of independent variates 


; E i fa) = | Л©9Л@-®4х=|_, ло) = ()- ЕС 0), 


(2-х) = 1,0 <2-х< 1, аѕ Y - U (0, 1). We note that 
Bot КОСЫ 5 2—1<ж<2: 


o = Ae, P(X <b) = | ле" 1-е" 0) 
i {U <u} = 1- P(min (X, Y)>u} =1-P(X2u) P(Y2u)=1- e". ez] cn 
a 21e i 74 и> 0; Cae. 0, elsewhere. [F'(u) = f(u)] 

pe FLV У) = = P(max (X, Y) <v} = Pix sy Ys} 

| P(X <v). PY Sv) = (1 zy [by indep. and by (1)] 

= 20” (1 - 2c 82 ; fy = 0, elsewhere. 


ES Ee. Sec. 4-62. Page 182 


ee E206. OP LO 
бс buted with densities : 


X and е ө independent distri 
(om ENS x0; &O = =2ye" 


ел =» ane, x20. 


„ pred. 
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O(x, y) b, 


- › = и sin Ө, 
х = и со$ Ө, у au, 0) 


(b) We change to polar coordinates : 


, Lu T 
Also x 2 0, y 2 0 (the positive quadrant) transform to 0<u<0,0<90< 57. The joint 


p.d.f. is thus 
кы 1) 


gu, Ө) = f(x, у)ІЈІ= ди? їп Ө соѕ де" lul 
(1). This gives 


To find the density of и, we integrate out the unwanted variate Ө from 


g(u) = 4u' e" ("^ sin Ө cos 0 00 = 207 е" .u 20. 


2*. Let z = xy, w = x ; then АЛ =i- xIzIwl; so dx dy = dw dz | w |. The joint 
2 O(x, у) 
probability differential of X, Y is 
dFy у(х, y) = (n y1 <x аз ye? ахау, =1<х<1, O«y«o CY EY 
2 2 
Е, w (2, w) = Ede (exem). —0o0«2«900, 0«wcl Ia 
i n П-у? Ww Iwl 


Note that w < 0, since for z > 0, f(z, w) < 0 when w < 0, which is not acceptable. 


To find p.d.f. Z, we integrate out the unwanted W. Thus 


zdz | exp (—z ? [2w?) ze * ^ dz ч | ы) (12)-1 
— pe dw aav ЖЕ -= |.7 А 
Trail, d TEES = 7 ехр 5 t dt 
=E 2/2 
ze I(1/2 е 
2) = = , 
Laud п Jiaz2 А ® 
3*. (i) Here Дх, y) = x^^! y^"! (1-x – у) / Bab, c), x 30, y 20, x e yl. MUR 
Now x = z, у = t(1 — z), | (х, y)/O(z, t) | 1 — z, ахау = (1 — z) dz dt. 
I-x-yz-(1-0)(1-z2;x*-*ysl —0stzsl. 


& t) = у(х, y)JI-z^'. [0-3] [d= 1 ә). .(1— 2)/ B(a, b, c) 


dF Д) 


—%0 <: < 00, 


a-l h+c-1 h-1 - 1 
о. (l-z) t (1—1) 
Wats RE ye ee 


It follows that Z ~ B, (a, b + c) and T ~ Bb, c) are independent. 
(п) Let u + v + w = s then set u = ps, у = 5, уу = (1 —TP-ugs-Thus 


O(u, v, O(u, v, w) à 
Әр, 9,5) s“. Now и20,0>20, м>0 => р20,420, р+д<1. 
The joint density of indep. variates U, V, W is 
ee ("Mr C9 uH 


flu, v, w) = ҮП) Гот) ^ Tn) 
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m-i 7 


g(p. 4» 5) = f(u,v,w)lJI = е " (ps) (gs) [1- р- 4) 5]! . 52 
Ai U (0) F (m) Г(п) 
ategrate out s, (0 < s < oo) to obtain 


| {1 m-i m y 
BEER T E ay. 
е. 9 x Г(0) Г(т) Г(л) 1, E E .ds = "d 


6-1 gd “a meg)! rizo 


rOTr(m) r (n) 
¢-1 m-i paj 
EET (d-»-9)" 

* B®, m, n) > P20, 420, р+д<1. 


| As usual, f(x) = k foc »dy- x( а 3l - ‚|+ -= x°). 


iil 1 EM. 
T лода 24 (1-1)- 5, hence k = 3 and f (3) = 2072, Охе x«l 


O(x, y) 
"| A(u, v) 


h 


a 


td isity. Letu =x +y, v=x- y, so that x= зиз), у= gv) 


ИСХ O<u+v<2, 0«y«120«u-v«2 
O<xty<1 = 0<и<1,х>0 = и+у> 0, у> 0 =и> у 
ion of integration is shown іп the Figure. 
vint p.d.f. of U.V is g(u, v) and is given by 
u, v) = Дх, y) IJl =3u/u (и, v) € D 
rginal density of U is 
d = 2 О<и<1. 
al density of V is 
lu 0«v«1;g,()- L udu, —1<у<0 
ia 80) = 
„0 К-С и )-1«v«0 


f " 


di 


© Sec. 4-10. Page 186 

„ = 96a = = 1 so that a = 1/96. 
2 64a . 60a = Р(ху) PO) > X an 
s pairs (ху, уд), (ху, yD: G5. Уз), Gy Ye Or 
(a, y SAA 


d Y are not independent. 
y (х3, у 1). Oy Yo) it can be 


ww ку to find some counter example as 
ice 
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2%. XY x1) =P(X=1, Ү= 1) Ы (Х = –1, Y=-1)} = Р(Х = 1, у= 1) + Р(Х = у 
= P = 1) P(Y=1) + Р(Х = 1) PY = 1) = (1) + (1) 
PIXY = <1) = P(X = l,Y2-DUXs-1, Ys 1)] 
= P-LYs-D)eP(X--LY212(0)2*0) 
Thus P(Z = + 1) = 4, where Z = XY. We check independent of X and Z. 
P(X = 1,Z=1)=P(X = 1, Y=1) = P(X = 1) Р(Ү = 1) = 1; АХ=,2=-)=АХ= 115-10), 
P(X =-1, Z=1) = P(X=-1, Y=-1) = 1; P(X=-1,Z=-1)=P(X=-1 Y=) = 4. 


Thus P{(X=+ 1) (Z=+1)) = Р(Х = + 1) P(Z=+ 1) > X and Z= XY are independent, 
If f is to be a p.d.f., then we 


3*. The region of integration is that shown in the figure. 
must have, k > 0, and 


1 = Горо? а. (1) 


(i) The x-integral is convergent only if B + 1 # O. 
Further, В + 1 must be positive i.e. B» —1, otherwise 
f (x, y) < 0. Hence, when В > -1, we can choose k so as 
to make f a p.d.f. 

(ii) Assuming В > –1, we complete integration in (1) 
to get 


1 м у? +! 1 s 
b bar (B+ D (B +2) EE > 


(iii) We now find marginal densities of X and Y, 


hes kf. (y- 3 рт)?" =(B+2)(1—x)P*!, O<x<! 


fp» kf. =? de=[8+2)(—y-9"'] = G42) 9", 0<y<1 


4*. The given ranges of x + y provide that 0 < 2 < 1. Now 
i£&z) = ((Zsz:X-Ys1)' g(Zsz:X4Y2 1) 


ES 


YU Z2» : 


(i) 
P(Z<z) = P{Z<z:X+Y<1}+P({Z<z:X+Y21} 
= P{X+YV¥<z;X+V<l}+P(X+Y-1<7z:X+Y21)- 


| 
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| e mma 
wees 2;X+Y<s1) = 1,2 » : 
p" 4 | 2^ [shaded area in Fig. (1)] 


+¥sz+1:X+Y>2> Ll. 
P(X 1) 7 [shaded area in Fig. (11)] 


substitutions into (1) provide P(Z < z) = 
ү gAz) = Pz) = 1,0<2< 1. 

5*, Let U=X,V=X+Y; рих = и, у= у-и; then! (x, yy(u, v) | = 1. 
Now PEx<y > 0<2u<ve<o, The joint p.d.f. of U, V is thus 


Ma Wm Wit, y 2262" <u ereo 
Marginal distributions 


2-1(1- 2) =2,0<25<1. 


giu) = J) 2e" du=2e™, u20; g,()- [^ 2e" du- ve", 20. 


6*. f is everywhere to denote the p.d.f. The arguments involved shall clear the context 
of the random variables referred to. | 


Хх, у, 2) = Rx, y lz) . flz) = 1[+(1- 2)], (х +у),0<х,у<1,0<25<2. 
(a) To find f(x, у), we integrate out z to get 
fx, у) 


1 
> EN = [iayl 50) лает. 
Тһи$ Ах, y) = Љо). fy) => Xand Y are independent. 
(b) To find f(x, z), we integrate out y from f(x, y, z) ; thus 


1 2? 
zh [z+(l—z)(x+ y)]dz=1,0<x,y<l. 


fix, 2) = tf 1+0 00+ d= G10 +2) + 20-94} 0<х<1,0<<2. 


Since f, (x) = 1, f,(z) = +, we observe that f(x, z) + fel) ХӘ — X and Z are not independent. 
(c) Let X + Y = V, X = U, then x=u,y=v—ul д(х, у)/д(и, v) 1 = 1. 
The joint distribution of U and V is thus g(u, v) = fx, y) 1J |, i.e. 
g(u, v) = 1 ‚Ои «1 Dre Pe 21 
(d) Let W = max (X, Y), so that O < w < 1, since max X = 1, max Y= 1. 
PIWswlZ=z) = PlXsw. YzwlZzz) 
„ырайы 0-067 12x d 
iata 11 2) w^ 0 «ow «1. 
ities y=, xu sothatx=u,y=v-%IJI= l. 
А а наон ® йй баш < 1и реи 1:0 552. 
о find the marginal density of V, we integrate out u to get 


fv\z) = fg@viz)du 
Now, if0<y<1,thenO<susvsl; 
if 1<vy<2;thenu<l<vsut+!s 


| А н -gvldu, SyS! [2+ (1- 2 vlv, O<v<l 
| 1». ho [2+ (1— 2 v] du | - fola 90-15052 
EU erdaldu 15052 


2orv-1su«l. 
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Chapter 5 : Mathematical Expectation 


scent Sec, 5-32. Page 198 BELL. 


1*. (a) Ed XI) = Ex. (1/ х) = l1 1 41+... 

The sum involved in unbounded; hence E(X) is not defined. 
o0 i © cy 5 o (1 
i=] i=] ui T 


The series ¥(1/i) is well-known divergent Harmonic series. Hence, XI X 1) does not exist 


o f Qr o (qM tl l 
Note. Stet edis D . is a conditionally convergent series. 
i=] isl L 


(c) Eaxn= X—— D ) 


xui OS ^ 1) х=] 0 + 1 


This is divergent (harmonic) series, hence E(X) does not exist. 


d. T 
= ~: This integral does not converge. 
(x+1)° 


(d) Ed XD = [ x. 


= ах 2 pour ОХ 
IE «B dy 1 9X шк e+ flog (14 x do оо. 
{> n(14 x^) л 40 1+ х2 zi g( Y )lo 


Since the integral does not converge absolutely, E(X) does n 
2*. Assume X to be continous with an integrating density f(x). If E(X) exists, then 


HAT) 


ot exist for the given p.d.f. 


E(X) = f^, xf Q0 dx « 
and the integral on the RAS of (1) 26 а 


[лода = [Ll f) dx s ELX ө. 


bsolutely convergent. Hence using f(x) > 0 


Conversely, let E(IX 1) < oo, then LM f(x) dx « vo 


This shows that [feo dx converges absolutely [f(x) > 0], i.e. E(X) certainly exists. 


Further : 
| foo ах [s [lal £09 а => IE(X)ISE( XI). 
If X is discrete, the proof follows by replacing integration by summation of series. 
Note. IXI- X202 E( XI) 2 E(X) 2 E(X) SEQ X) S IE(COTS EQ X D. 
i S X, +..+X Х, X X 
е. | -E| 2^ | g| =" |-Е| +t А, 
3*. (i) ң: | d 3 | 6 + 5, +... + x [Lin E] 


n 


X 
e eZ e)... (&)-ve( SH [^ X; are i.i.d.] 
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Е(Х /5 у: l/n. iW —— — "m 


E ЕХ, +... + X,)/S, «E Y : 
= А, Sn] (XJ/S,) +... + E(X,/S,) = КЕ(Х 18) = Мп. [by Lin ЕЈ 
bu +E(X, 15, =t)=nE(X,1S, =1) [By Lin E] 


y p= EG, |S, =n) =E(X, 15, =1) +Е(Х, 15, =t) 
SEX, 1S, = 0 = in by (1) 


ning. Distinguish betw T Tm 
ing: Disting een the symbols, fractions / and conditioning ‘I’ signs 


E ufo dx» [y f(x) dx = 9, E Т 
( =f» f) É YF (x) dx = | (2x + 3)e dx + f; хе ‘dx [y= y(x)>0] 
— (5-11e?) «4e? 25. 7.3. 
at f ) be the p.d.f. of X. Let J denote the given 


оаа [] f. Soda [joa [7s 


ig the change in the order of integration of region 


[шша - Eco [Kernel definition] 


m 


= P(X, =n... X, >п) = P(X, > пу. P(X, 2 л)...[Р(Х„ >n) P(X, > n)" =(r,)" 


"T 


^T E . . 
variates are i.i.d. and Y is min [Xn Х|, 86 


2) = УРОХ, == Xp-n. 


:ger-valued variate : E(Y) = È PY 2n) = (r,)" sUh) 
И n-l 

> m(p), P(X; Eq !p, eet, A e SO 
5 


ey Sg p= pq” ‘(1 tqq +...)= 4". 

ЭТ « 

(q" y^! -1/0- 4"). [by (1)] 

Y= s (X,, .., X,} - gem (p), where p 21 - 4 

f upper-tail probabilities is beneficial. Call D, = rth draw. Now 
| Я s required 


1 because at least two draws are alway 


ET n-1 1 


n sl. 


P Distinc numbers on р, D;) - n n n 


ы n a-1 2-2. (i. D)(1-3) 
| MN 


| Е 1 | 2 | ( k- L) k= l, pA a m 
nA А ER n 
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2-65)-0-2- 6-527] 
yos: ioi us pfit De n nj. n 


1, 2 k- 2 (8-1 EE] 2 3,... (p.m-f.) 
»-(-16-3)-(- "diea ids р 


п 


Е(Х) = y P(X > k) = P(X > 0) + P(X > D + P(X > 2) + — 
k=0 


a CEA E o a 


Obviously, P(X > k) = 0, for k > n. | 
8*. (i) As P(X 2 x) = P(X > x) - P(X 2 x;, |); we rewrite it as p; = P; — P; , ı (with obvious 
meaning). We now have 

E(X) = Xp; ‚ =“ шл (Р R у= XxP - Ex; - Б.» Eae Ul 


= Lok - Èn- P= AOA [x = 2] 
i=] 
(ii) We rud the stated relation: P(X 2 x) 2 PŒ > x) by (x; -x; 1) > О and sum up 
to get 
E(x, — x4) P(X zx)2S Xj x) PO 2 X112, n 


E(X) 2 E(Y) [by Part (1)] 
Relation (1) implies that distribution of Y is shifted to the left of the distribution of X] 


9*. Define the indicator X, by : X;= 1, if A; occurs; X; = 0, if A; occurs. 
Then, E(X) = Р(А;). Now 


2 n 
о[ан) (бех (бах )- È Хаах, 


Nothing Е(Х,Х) = Р(А;А) and taking expected values in the above relation 
0x XX aa, Ес) = LY аа P(A; A) > 0. 


10*. (i) EGO) = (-D^. -1) + 0° . AO) + 1°. f) = A) + 8-1) = [Д1) + Д0) + 0) 
-f(021-1/221/2 К) + f(-1) = [) + &0) +f 


(ii) Е(Х) = CD f-D +0. f(0) € 1.0) = f) - f-1) = 1/6 [ p= 1/6] 
Using f0) = 1/2 gives A1) + A-1) = 1/2, hence K1) = 1/3 and f(-1) = 1/6. 
11*. Let X denote the (random) number of face (picture) cards obtained in a Bridge 


Р(Х = х) = = Эй). s] 


ч 
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O — anh 
h S of APO 52 Ы (152 
t Eo) = 2 (1) (0 )/ (8) = 123 C (2 /(8) 
к 
" (3) (8) =з [Ву Hyp-geom Identity] 
p. Here Q = (М. TH, ТТН, =e Suppose the head occurs on kth trial; then 
! Р(Х = k) = qp, [X ~ gem(p)] k = 1,2, 3, ... (p+ q = 1). 


E is the number of trials (tosses) to get the first success (head). 


E" Ука“ р) = pU +24 + 34? +...) = р(1- q)? = pl p! =1/ р. 


a fa B Ai, - 1/2, so E(X) = 2. 


E : et the variate X denote the number of failures occuring before the first success. 
( - failure, S = success). 


P(X = K) = P(FF ... FS) = P(F) . PCF) ... PCF) P(S) = d p, k = 0, 1, 2, . 
ONE 
z о-о ye pa ia! i 


| P (l+ 2g + 34? + 4q° +...) = pall - 9)? = pq! p! - ql p- 04 p) -1 
he variates X, and X, denote the face values of the two cards, X, # Х,. The probability 
is xtraction is (1л) and that of the second extraction is TC = D. Hence 


а E. 


› > UNE 


с мна |) 7) 


P- {n(n +1) (2n + 0/6] = п(п+ 1) (36 — n- 2) 112 = n(n 1) (n – D (3n + 2)/12. 


х) ( 1+ 1) (3n + 2)/ 12. 


" 3 "d 8 24 8 
a, F 00 = tla. So, using survival function, 
In. 


(>) Р(Х, >x) PG,» x)= =[1- P(X, < х)" =l- G7 a) 


Es 


TET => f= lall- -(x/ay, te Е'О) = О) 
a) 4 31a) (lll - GL a)'de e 3/5 


y 


E (tha 17 
MEI 


ed Problems 
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Sec. 5-42. Page 201 һе ——... 

t; B and G the event of a studen, 

being a boy or a girl. Then, by Multistage E-Rule, E(H) = P(B)E(HVB) + P(G) Eig IG 


Here P(B) = 0.6, P(G) = 0.4, E(H | B) = 65, G G(H | G) = 60. 


E(H) = (0.6) (65) + (0.4) (60) = 39 + 24 = 63”. | 
ше ІХ = = i}, PAIS 3. and thus P(A ) = 1/5. The expected 


1*. Let H denote the height, in inches, of a studen 


2*. Designate the events : A 
value of Y is given by Total-E rule : 


E(Y) = P(A,) E(Y1A,) + Р(А) Е(ҮТА,) +... 
Now E(YIA) 2 LE(Y1A) - (2)1 2432) 2 3/2 EY A) = ( 4) (1) +(4) (2) +(1)03)=2, 


E(Y1A,)=(4)(424+3+4)=5/2, Р(У1А,) = (175)(1+2+3+4+5)= 
EEST + (3/2) + 2 + (5/2) + 3] = 2. [by (1)] 
3*. Observe : P(X =j | Y = k) = l/k, because the second card is selected from among the 
cards 1, 2, ..., k. The conditional distribution is symmetric about X = 5 (k +1), which is 
the mid-point of the extreme values 1 and k. 
This gives E(XIY =k)= bk +1). Also, P(Y = k) = I/n since Y can take up any one of the 
n values. Thus by total-E Rule : 


E(X) = E PY = y) E(XIY = у) = EP =HEXIY=k)=5-¥( (ep fI. 
k=l rm 
—— Sec. 5-62. Page 210 En LS OD 
1*. Let X — uy = Xo Y - p, = Yo, then 
Н = E((Y; — bX) + (My — by = ay [Putse = My — buy — a; use Bin. expansion] 


= E((Y2 + b! X5 — 2bX,Y,) + c° + 2c(Y, — bX,)} 
= Е(ү2) + PEQG) -2bE(GQY,) +e? [by Lin E and by E(X,) = 0 = Eo) 


= су + сх — 2b6 xy £c [by def. of Var- & Cov.] 
To minimize the value of H, use calculus rules : 


oH н 
(52) =2 45 c)=- 2; (2H 7 ]= 2boy -20 xy, ES c-0 ew 


OH 2 oH ôH Ў 
wate >®| ж 2 о) 0р оў =ро, Га, à 


min H = oF tofo? -2o zopa -ph tby (1) nd P" 
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эж Let the joint p.m.f. of X and Y be as shown 

and а, b, are any positive numbers and 4p = 1, 

Then. Р(Х = 0) = p, P(Y = 0) = P. P(X20,Y 20) =0, 

since P(X = 0, Y = 0) = P(X = 0), P(Y = 0), the 

variates X and Y are not independent. Now 

E(x) 20.P + a .2p + 2a - P = 4ap = a: 

Ey) =0-p+ b . 2p + 2bp = 4bp = b 

E(XY) = a(2b)p + 2ab)p = 4abp = ab 

T1 E(XY) = E(X) E(Y). 

3*. Let X, = 1, if the head turns upon on the ith coin and X. = 0, otherwise [indicator 

variate]. If X is the total number of heads on the л coins, then X — Ket Xo... dX. Now 
E(X) = E(x, + Х, +... + x)= E(X,) + Е(Х,) +... + E(X,) =nE(X,). [by Symmetry] 

If P{head turns up} = p, then E(X) 2 1. p40. q = p; hence E(X) = np. 

If the coins are unbiased, p — 1/2 and then E(X) = n/2. 

Comments. If four coins are tossed, then E(X) = 2. If 5 coins are tossed, E(X) = 2.5. 

This shows that the expected value of a discrete variate is not necessarily one of the 

possible values of the discrete variate, in which case, we would not "expect" to get 

the expected value. Hence the term average value or mean value is better than the 


term Expected value. 
"RU a PENES 


4*. Let X,, X), X3, X,, X, be the number of non- | == Х, ———— 
ET = : : ges : Ч ге —-—————Є——Є—- 

ace cards as shown in the adjoining figure. Then, 
В —_ 


X,+X,+X,+X,+X,=48. 2 a 5 m——— 
E(X,) + E(X,) +... + E(X.) = 48 "mo l P EE 


Now E(X) = E(X.) =... = ЕСХ.), 3 a h — ————— 
because any number of non-ace cards can be X 
situated anywhere in the five spaces available. 4 SE IL E 


Hence, (1) gives, SE(X,) = 48 => E(X,) = 48/5 = 9.6. 
5*, Let X, = 1, if ball from urn i, 1 <i € 3 is white; 
X, = 0, otherwise. Now 

E(X,)=1.2+0.2=2; E(X,)=14+0.5 
"io X, X, + X,, is the number of white balls drawn, then 

E(S) =E(X, + X, + Х,) =E(X,) -EQG) + ЕХ.) =F + * $7 08. 
65. We use the indicators : Let X, = 1, if ith ball drawn is white; X, = 0, otherwise. 
S is the number of white balls draw, then obviously 5 = X, + X; +... X, 

E(S) =E(X, + X, +...+ X) =E(X,) +Е(Х,) +... +E(X,) = cE(X,) [by symmetry] 


Now ; E E 
3 X. = = 0. b/ + b)]=a/l (a+b). 
(X,) = 1a/ (а= b)] - 0 .[b/ (a when nothing is known 


abe use, the probability that the ith ball removed is white, Gil | 
the colours of the preceding balls is a/(a + b). Hence, E(S) = ac/(a + Б). 


m : 
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7*. Here Q = (1, 2, 3, 4, 5, 6}. Suppose integers X and Y are drawn in succession 

without replacement; then the p.m.f. of this drawing is f(x, у) = (1/6) (1/5) = 1/30. Now. 
E( X - Yl) = 2E(X - Y), (X > Y). We find the set of such outcomes. 

(IX-YI:X»Y) ={2-1,@G-1,3-2),@- 1, 4-2,4-3), 6-1, 45-4. (67 1, 6-5) 
» 11, 2, 1), 03, 2, 1), 14,8, 2, 1), (5,5 5,277] 
E( X -Y I) = 2/30) [12346 +10 € 15] 2 7/3. 


8*. Let X be the r.v. describing incme liable to tax so that X h 
provides k] [by normallization] 


[See also Сһар. 1. p.14-15) 
as the p.d.f. f X); this 


1 ак хах => k -00*. 


The static t(x) describes the amount of ta 
is E[t(X)], hence 


x, so that t(x) = c(x — a). The average tax paid 


5 dx of 1 a x ck Bog 
E[t(x)] = ck] б-а) a = |, (Э-э) gcn = 0-1 EWON 


Let the static I(x) denote the increase in tax, then I(x) = c(x — р), x 2b; x) =0,asx<b 


>Ч ес vain ven See. аре и 
EVOO |, «жт 0 т gq lye (ө ГУЙ [by (1)] 


The percentage increase in average tax paid is 100 EfI(X)J/E[t(x)] i.e. 100(a/b) 
This equal 20 provided (b/a)’' = 5. 


9*. E(XY)= LE xy. (at у?)/42= ууу + xy") 42 


0 - | 


= (1/42) Y 8x? + 27x)] = (1/ 42) (3.17 + 27.5) = 31/7 


> (x+y? 1 pa PE 1 8 
ойо = zz (2 )-uxxbn Jen) m nin 


кы 415] 508 [155] 
= 112+ 4 Iis PE 


10*. From definitions of expectation and c.d.f., we get 


Eļu(a - X)) = | ща- х) f(x) dx= | f(x) dx = F, (a), 
Similarly, E[u(b — Y)] = Fb). Further, 


Elu(a — X) u(b-Y)) = |? fe ua- x) ub — y) f(x, y) dx dy = | |]? f(x, y) dx dy = F(a, b) 
If X and Y are independent, condition (1) is obviously true. If condition (1) holds, W° 
get Fy fa, b) = Fy(a) Fb) = X and Y are independent. 
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11*. As usual, J,(@) = 1, if œ € A44; Јо) = 0, if @ e A, е. j v". 
(i) Assume that events A, 1 <i < 


n are mutually independent. The definition (1) 
uarantees that J,(@) is a function of A, Thus the mutual independence of A,'s imply 
the mutual осаго OF 4%: 


(ii) Assume that the йн. variates J,, J,, ..., J, are independent. Then, 
B4.) = E(A) E.) EW) ws 

Since EU J, ыз Ja) 4 EV aa, A= P(A\A, ZD A,) A3) 
P(A,A, ...А,) = P(A) P(A,)... P(A,), [by (2) and (3)] 


We can similarly treat some or all complements of the events A,'s to obtain the other 
conditions for mutual independence, etc. 


—— Sec. 5-75. Page 218 I. cocos DN 
1*. Since X is partly discrete and partly continuous, we use 


EQ - o -k[ с) [1- Fool dx | (с)! F(x) dx (1) 
Take c = 0, then (1) yields for the present case 


EQ) = kf x‘ (pe^?) dx = pHT (9 А] 


E(X) = р/А,Е(Х?) -2p/ X, Var (X)  pQ- р)/ А. 
2*. E(X) = Op + 2p + 1(1 — 2p) = 1; Е(Х?) = Op + 4p + 1: (1 - 2p) = 1 + 2p. 
Var(X) = Е(Х2) — EX) = 2p, 0 <р < 1/2. Thus max[Var(X)] = 2 max p = 2(1/2) = 1. 
3*. Let X, = +1, if the ith step is towards the right; X, = —1, if the ith step is towards the 


left. The, E(X) = р(1) + qC- 1) =р- 9, Уі mS 
Also 5 = X, + X, +... + X,, represents the random distance from the origin after n steps. Now 
у= (Ух) = = ZEX) = = п(р-4), [by Lin E and ase tI 


Also, E(X2) = p?  q(-1) =p +q = 1; Var (X) = EXP) - EX) = (p +4) - (p 9) = 4pq 
Var (S) = Var (УХ) = LVar(X;) = 4npq 

4*. Twice diffentiation of a GP. : I4 z* +z *z5 +... = (01-2) " gives 

4 224 37 +422 +... = (1 "d +3: + 60 + Oz +. = (17 2). engl) 


EQ) - Ў (pq ke pL kgh =pl 7^ =1 p, [by !(a)] 
k=l k=] 
EXX- D] = $ pg*-! kik 1) = 2pq(1 + 3q + 64° +104' +.) = 2pq 01 7 a)" = 2p/ p' [by (1b)] 
k=] 


Me. EQ?) —E(X) = 2q/ p? => E(X*) = (24/ pO) V р. 
Var (X) = E(X?) -E?(X)=(q/ p) 
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5*. The probability of getting a four is p = 1/6 and that of getting no peur ч. = 3/6. If 
es v. X denotes the number of throws to obtain a four, then the probability distributio; 
is [S = Success, F = Failure]. 


Q : S FS FFS FFFS T FF ... FS 
X : | 2 3 А м | 
Дх) я р qp qp qp JU aq р 


The most probable number of throws corresponds to the maximum probability, which 


is p = 1/6. Hence the most probable number of throws is 1. 

Further : E(X) = t/p, E[X(X — 1)] = 24/р> TEx. 5-27(a)] 

With p = 1/6, E(X) = 6, E(X?) = 66, Var (X) = 66 — 36 = 30. 

6*. Let AP = X, then PB = 2a — X and so the area of the rectangle АР. PB is S = X(2a - X). 
Also, the point P is uniformly distributed over AB — Om so that f(x) = 1/2a, 0 < x < 2a. 


Now [S2 1a? = (X - a <1а?}= (а/ 2) & X <а + (a42) 


P(521«)- ТУТ: 


dx 2a 


Үз aid à 2a M. ах _ 
E(S) -EQaX - Х?) = |, Qax- x) =<. 
E(S?) =E(X* – 4aX^ + 4 X") = [А (x* - дак? + 4а?) E = 16а? /15 


2 16a 4a* 4a'(12a—5) 
У; S = E Se -E AS =й сс ы M A EET 7 
ar(S) (5)-E (S) 1s I YR TES 
7*. Неге f(0) = k0(x — Ө), 0 < Ө < іл where k is determined by normality : 
1/2 2 3 3 
k| (n0-09? “=H зыш we 
É ( ) T ETT 12" ==; - 


120(x - 0)/ 1,0 «0 « m. 


fO) 
The area of the said triangle is $=1а° sin®; hence 


120 (x – Ө) 6a? 
3 


а? (то, 2 ; 
E(S) = SL sin 0 do = DS — 0°) cos 0 + (1 — 20) sin 0 — 2 cos Ө] 


= 12a°/n*. 
E(S?) = A [ne - 0?) (1— cos 20) dO. {> 25іп20 =1~— cos 20} 
а MES seg] - [лө 0°) c0520.0 P) 
Now, f" (n8 — Ө?) cos 20.40 = [ -0 0 , (a 39) oe 2 раг i 
0 
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Substituting into (1), we get 


КОШ За; а* А " 6 4 
ge 8e. 14 zx dt. d 3m -1152 
8л” 8r? vd o з ББ 


ә „ 4 2 
Var (S) = Е(52) -E s) - 4 +T) 
. . 8n 
8*. Associate with ith trial a variate X. defined by 


ДР 1, if success occurs P(X; = 1) = pj; X; = 0, if the failure occurs, P(X; = 4) = q; 


Let S be the number of successes in л trials, then 5 = X, +X, +... + X, 


E(S) - E(X,) +Е(Х,) +... + EX = 2p.lsisn 


= Var (5) = Var (Х,) = X(p; – р?) = Zp, – Xp; pou D) 


When p, = p, then Ур, = пр, so that p is the mean of the quantities p, Let со be the 
variance of the quantities p, so that 


со =[(®р/)/п]—[(®р,)/п]' => Ep? =п(р? + с) (2) 
From (1) and (2), using Ур, =np, we get 

o? 2 np - n(p? + с) = npq - no}. "e 
Since p, = p (constant) yields Var (X;) = pq, so in ttis case Var(S) = = = npq, 

с2=с2-пс > 561-0 =п60>0 > o<o.. 


Chapter 6 : Moments and Quantiles 


Sec. 6-13. Page 227 


1*. Boundness >  P(IXIx B) = 1. Assume that X is continuous with density f(x). 


Then for any integer л > 0. 


f. xl" fix) dx x [^, B'fG) dx = B" |Р) dx = В" «o. 
Thus E(X”) exists for all n. The proof for discrete X is no more different. 


2*. Suppose X is continuous with p.d.f. f(x). Since p; =E(X*)<o, the integral 


[x f(x)dx converges absolutely. Now 


E(x’) = [lx f(x) dx lim figen Ix РО) ах A) 
Also E(IXI*) = I" lxi Ро) dx - lim ff... Ixl‘ f(x)dxt fii, Ixl‘ f(x)dx} ada) 


Letting n — оо in (2), and equating it to (1), we readily obtain 


= d 


714 À ) Á soltionstoSterredProblems — 


lim has fæl xt dee 


But in Ix foo dx > п“ em f(x) dx=n* P(\X\>n) (4) 
Letting n — © in (4), using (3) we get the result : lim КОР ГК |» n) =0. 
Converse of above result need not be true. Suppose a variate X is defined by 
Р(Х = п) = k/n? пп, п= 2,3,4, ... [E (к/п? пл) = 1] 
о Ках k | 
Тһеп, PII X = = << — red ( 
(I XI» n) PTX лүе mx ninn ) 
| SOM, OD METUENS TIRE 
pA тх "inn | x? inx nn i x2? ninni 
From (5), it follows that nP {| X1» n) < (К/ пп) 50 «s n o. 
But E(X) = EnP (X = n) = E[k/nÜnn] = o». When X is discrete, the proof is similar. 
Sec. 6-25. Page 231 ранае 


1*. p, = pi- 3p, p; + 2 = 1n(n D - 1001 1) (2л +1) e (л + ly +0. 
Thus p, 2 0, = y, =0, so that skewness is zero. 
2*. y, = E(X") = |? x" f(x) dx. If n is odd, the integrand is an odd function of x, hence 


above integral vanishes. Thus 


E* “оу = Ne 2 "ES M T 

Ho, = 2| x? Го) dx - gr; |, Ө z? ө » Az dz, ipee] 
= T{[(2n+1)0]/ A2? Г /(0). 

В, = р, ^u sIGD КӨЛДӨ”. 


3*. Here E(X – 2) = 1, so that p = EX) = Зер = Now 

и, = pj- 2 216-1215; p, =H -3p my + 2)! = - 40-3 x 16+ 2- 86. 
Further : 16 = E(X - 2? = Е(Х?) – 4E(X)+ 4 =E(X*)-12+4 => Е(Х?) = 24. 
-40 = E(X - 2? =Е(Х? - 6X’ + 12X -8)-EQC) — 6 x 24+12х3-8 = E(X')=76 
Thus, first three simple moments are 1, 24, 76. 
4*. With usual notation : 

p = ph -p 24-123 р, =p" – Зшш + 2(uj 210-3x 4+2=0, 

Hy = и 4p, wl + бру pi? – 3: 245-4x10 6x 4 - 3= 26. 
Also, E(X-4)=1 > EQ) = р= 5. B, =p2/p3=0, B, = (p, / n2) = 26/9. 


Solutions to Starred Problems E ET rj 1 5 


——  —— 
Sec. 6-51. Page 237 ——— 
1*. Let p be the mean of the series that consists of (2n + 1) terms, then 


= [a+(a+d)+(a+2d)+...4+ (a 2nd))/ (2л + 1) 


= [Qn а+5 (1 + 2n) .2nd]/(2n+ 1) 2 a * nd 


Xl(a + rd) — (a + nd) Id! 2^ 

8 —— ——- ar e: | n(n* d 

(p (2n + 1) dua 25.7 Ec diete t к. 
Кем) (апар аг > 2 hus 
ce 2n+1 anil i (r—n) = 2 Aig 09 4 mye 


CRT o? —[б(и)]? nn*)d _ n(n+1) a? ull, ndis 
3 Qn + 1)? 3(1л + D? | 

Obviously, D > 0 > o? »8/(u) i.e. с> 8(p). 

2%, Since M denotes M.a.D. about mean m of the frequency distribution, we get, by 

definition 


M= Fiir- me pl Ла) Ei d 


м Yyfo;-m Xf (s 7m) zii) 


Xi <m x;>m 


Also,0 =E(X – т) = pd a- m-x E fi- -m+ Y fou т) 


х<т х>т 


To eliminate unwanted inequality x, > т 
Subtract (2) from (1) to get 
= -QIN) X. f, (x - m = (21 № v ifr УЛ | 


х<т ¿<m X; <m 


3*. The d.f. for X is given by 


[5] k S. 
F(x) = 0.1#х<1; F9- p (2) 21-Q). if x21. 


wh. 


From F(x) = 1-(1) , we see that F(1) = 5. Hence. the med X = 1 (1 + 2) = 
The mean y is given by : = E(X) = zx(i). xm 2e-- 


Differentiating (1 — 7) = Er', we get а —03.5 xr хе 1,25. 


p = 1(1 a =2 [using r = + in above series] 


The mode of X is 1, because fl!) = iis the maximum probability-ordinate. 


7 1 6 Solutions to Starred Problems 


Sec. 6-61. Page 241 ——— 


де, Let т = = t? , then E(X - My = Pu MY, which by Lin E, yields 
2(M,-M.) E(X) = Mj -M? > E(X)= (My + Mn. 
Converse. 2u = (M; * M) => 2y(M,-M,)= Me - Mj 


Mj -2p M, + E(X)) = M? -2u M, +Е(Х?) > E(X - M)! =E(X - Mj) — t =t; 


2*. Неге: С = Е(һ х) = f 602 x)(x- Dinxdx- 6}? (x? — 3x + 2) Un x dx. 


Integrating by parts, we obtain 


| icu EU: 3 2 
- iG = (s ae кл) f Ily T + 2x | dx 
Eo onu. 22-1 
= 3 n2- lie -3* ex] =2 =—n2—- 36 36 


60nG - 6Un2' 219 > 601(166)=19 > Gez(LDexp(. 


3*. Let Y = X —m, so that Y is small to the extent that ү? is negligible. Now X = Y + 
provides, using Binomial Expansion 


X" = (my[1- Y/m]" = (my [1+ (nY/m) + nn -DY? /2m? +...) 


Е(Х") = (my Qo um ПО +...) R 


Using the linearity of E, setting E(Y) = 0, E(? i= o’, (D reads 
E(X") = (т)" (15 n(n- 1) с2/2т2) 


Putting n = + and – 1 in (2) we get 


2 2 
Due ur |, UE 1 | а] 


4*. We can determine С by normality Df (х) = 1. Now 


Fx) = ee ” z = Clan" a =c|Z + ana] 
Since F(o) = 1, the above ni ol „1 =o = Ge ir. Thus 
F(x) = (1) + (Ил) tan! x, -< x< o. 


(a) P(X20) = 1I- P(Xs0)z1- F(0)x1- у=? [by (1)] 


(b) Using F(Q,) = r/4 in (1), we get 
tan! (Q) = x(r-2)/4 = Q,-- cot (лг/4) 


Q,=-1, Q,=0, 0, =1, Q,-Q,=2 (quartile range) 


m 


1) 


Lat) 


4 


Solutions to Starred Problems "CR NAVI 


(c) = Б 13 opune veles =2¢ ( x dx 
0 


еї" 1+ х 
It follows that E(X) does not exist. Consequently, variance also does not exist. 
(d) Mode can be determined by 2nd derivative eu However, in this case 
mode f(x) = max f(x) = min (fix)) = min (1 + x)yC. 
Since min (X^) = 0, so x = 0 yields the modal value which is 1/7. 


SE DEO) = [px fG) dx- p x? ас+з[ 'Q- xy аса +3 P-Y de 7 xn 


1 l 
Б у = —+3[ ог Мел моды арчу 
Eu ue 
2 | 11 38 
EX) = —+3 = jee eee ee 
(X) 6 Í. m 4t? + 4p yif. es Dei 30 
pil tb оар: 38 od by 17, н), 
Hi 30 100 300° 300 
м = |х 0 Boos |хк-1|@- as 
eat а NIU S Е 
= АС x) dx +3 o 10 tit at, [22 х] 


0.9 x 1 9 
= ee |р (уотч зн (1-2) at 


5 
{Ыс Еа ы Фи РЕ АЕ 
A eet 5 Gu) up en 


(ii) This is similar to (i). 
6*. The constant a shall be determined by Normality. Now 


Bo) = р ух" dx =a}, xv deaf X (2 =x)*idx 


r+! $3 r+2 7° r+l r+ r+2 
RS Ax PUT Ре 
р [x ra] t73 | |+?” r+2 wal) 


һә 22 
5 


To find a, put r = 0, use E(1) = 1 to get: 1 = 4a [(3) + 1 - (3) = 4а/6 = а = 


We now ИКЕ l, 2, 3, 4, ... to obtain initial moments from (1). 


ES 7? 2 8 шатты 
3 iB sc» Ex! л, 2 е9. 
pr- ER 4 Al 10’ pa & €] 35 


We may obtain first four central moments using E(X'), r = 1, 2 and 3, 4. However, 


e E(X) = 1, we can use 


7 1 8 Solutions to Starred Problems 


EX- 1) = af (x-1) x° dx taf (x PT x» dx [Put x - 1 = y] 
^ aĵ’ y 7 + 2у *Ddy* af, y'( - 2y + D dy. 
id 221) af y (y? – 2у + D[I -D']dy [Change y > -y in first integral] 


When r is an odd integer, we get H»,,, =0. Putting r = 2n yields 


P % 1 2. 1 
ag = 2a m. > ~ = P C SHE 
io, = 2а] y"? - 2y « D dy db. xL xen 


H2 io^ 9 4 ^35 => oe =; Excess = E4 - к x : T 
7*, Assuming that given law is a p.d.f. we find that 
r “Алча кй чы r+ Г(г +1 £l 
E(X - a)" = yo f° e" *-"(x-ay = yoh e" а= e ede» Eubrce-2..() 


For f to be a density function, X f(x) = 1 (Normality). Hence putting r = 0, the above 
provides | = yyb = y= b and so 


= E(X-ay =r!/b". nl) 

When r = 1, Eq. (1) gives E(X)-a-l/bor m-a«b'. 

р, = php? (2762) - (ИБ) Vb => o=1/b. 
Combining : у, = b= Шс, а = т – с. 

My = р; = Зу ш; + 2p)? = 2/6" = 26". 
‚4р pi + 65 uj? – Зр! =9/b* = 9с“. 
А = 3 are ee 

u 


8*. We shall determine y, by normality У, f(x) = 1. Now 


П 
TANE Es 9c* Ao 
LE ч T 


Lg hy 2 Yo 
= Hu = x — di eee ls 
E(x’) Н Yo fo (х x^) (r+ 2) (r +3) 
Putting r = 0, н, =1= v9/6, we get y; = 6.Nowletr 1,2, to get 
w^ Е(Х)= 1, =. so o` =p -p = 2. 
W= EXT ye 3 > Hod 
MG = уо f(x х2) п dx 
1 
1 ба, a 8 eec ESA 
“ho че zl à Soul Ar 36 
G - exp (-5/6). 


Solutions to Starred Problems 71 9 
For Mode : f'(x) = 6(1— 2x), f"(6)=-12s0 f'(x)=0 5 x= 


L 
"m 


"gl = 
КОШ = ~12 «0. Hence x = i is the Modal value. 


E" the medium be т, then by its defnition 
= | 6(х- х2) de=[3x? -x => Ат? — 6m? +1=0. 
E (2m – 1) Qm – 2m - 1) = 0. This gives m= 1 є [0, 1]. Hence т = Q5 = 5: 


j- 


» 


Sit ce Mode = Median = Mean = |, the distribution is symmetrical. 


Го. de ermine M.D., we see бл 
MER) 


1 
M.D. = E(|X —5|)=6 f x - 116xa - x) dx, (Put x — + = 2) 
Ne i 1/2 Ls Ux 61 12,3 
A x | = TAE Ja uf (I-2)&- = 
te. We can find central moments directly : 
OP V2 ғ 
ec H= ELx-4) =6 f(x id) х(1- х) dx = Olen 2 (1-а Jaz 


= 2n + 1, the integrand is an odd function and so integral vanishes. Hence џ,, ; = 0. 
= 2n, the integrand is even, and we get 


) E ua ыр li >) " 3 
EE a : 0 cd nns 2813). 


2 
y^? ч gU - e de |5- | 
2g? 


ц' = Ше m... T(ir- 1). 
NS 2)- a2" ш = T2) 22d? .o? =W - (nd 12), > o s aJ(4- 1)12. ...(1) 
> h m Бел: | | 
| Vis M" - ауа lt TO i 
М yr £r МиР Р" ^ А 
«e „= ке whence 02 = 2a! In ($), Q? = 24" 4. 
= 9, 2404) – 0104/3077) | [Indep. of dens 
J4 -* =, r. bti — — 
nt a is determined by Normality Ef()-l Now 
wm = кереч, (6 - -2x»x deta B-a)? oie 


2 


A E - n ч / 
^- 3 uM 91)! = ДА " , Sha UN 
z - А 


720 Solutions to Starred Problems 
Putting x = —t in the first integral, transposing a to L.H.S., we get 


a E(x") = f, G-0^ C» dis f° G-x) G-x)x dx+ | (6-222) х dx 


= f (3-3) (1 +(-1)"] x dx |, (6 — 2x^) x" dx. [Dummy г > dummy x] ...(1) 
When г = 0, this yields the value of a 
a!» 2] (3-0) ах+2 (6-2x°)dx=2 2[8 14-16 


2n - 


Thus а = у. Further for odd r = 2n — 1, both integrals in (1) vanish, hence — 


= 0. Thus, all odd-order simple moments vanish. In particular, E(X) = н = 0, so that 
с> = Var (X) = E(X)). So, we put r = 2 in (1) to get 


1602 = 2[ x! G- xy! dx« 2 |, (6x? - 2x") dx 


i 3:01 3 2 1 ю 2 4 (64, а) - 
2 = — = = ИРЕ = | — 
i.e. б zii (x* - бх? + 9x )dx * 5 Jj (6x^ —2x^) dx 3 10*5 1. 


M.D. = EXD d xl f(x) dx 


= af lxi x dea f^ x6 - 23) dx +a f IxI(3 - x}? dx 


2a |? x(x? — 6x +9) dx 2a | (6бх - 223) dx =2а(4 = 0. 


Це Here 7,0) = E'G)-(Q c) (cix) x >, fix) -20ifxs c. 


E(x") = = (ae ios ина m provided a » r. 
EDU = Ep eue Var P = ay p 
dd ae (asd (nee) H2 = - н 


The median m is the root of the equation F(m) = 4=1-(c/x)* = (с/х) = (1)'“ 


Thus x = с 3138 is the median of the distribution. 

Obviously, for a 2 2, we have Sus. e al(a — 2) > m< y. Further, since f'(x) < 0 for x » с, 
the density function is monotone decreasing for x > c. As such, mode m, = c. 

The quantile t, of order р = 0.75 is the solution of the equation P(X < г) = p = 0.75. 


ie. 1-(c/t,)"=p => (clt) = p)" = (0.25) "^ => toys = 0(0.25) ^ 
With stated values : t, = 100/00.25)' = 156.2. (Using (n tables) 
Sec. 6-75. Page 250 m 


1*. Var (X + Y) = с> +07 + 20yy =2+2-6=-2 
Since Var (X + Y) « 0, the given data is not possible. 


—— Solutions to Starred Problems TÉ 1 
3. Here E(XY) # E(X) E(Y), so using Lin E, we get 
О = [E(XY) + EY )) - [E(X) + I]E(Y) = E(XY) -EOO EQY) = Cov(X, Y) 
Note. If X and Y are independent, then Cov (X. Y) 2 0. 
3*. For indicator variates, E(X) = P(X = 1), E(XY) = P[X = 1. Y= 1) 
X Cov (X, Y = EXY) - EX) Ey) = Р(Х = 1, Y= 1] - P(X 2 1) P(Y = 1) 
Thus Oxy =0 iff P(X = 1, Y = 1) = P(X = 1) (Y = 1). 
This shows that X and Y are independent. [Other possibilities X = 0, Y = 0, etc. trivially hold] 
Note. Cov (/,, /,) = 0, iff A and B are independent. 
4*. Let X, = 1, if card k falls in cell k and X, = 0, otherwise (X, : indicator г.У.). The 
probability of any card falling in cell k is 1/n. Now 
E(X,) = 1. P(X, =1) + 0.P(X, 20) = I/n; E(X2) = P .P(X, = 1) + 0° P(X, =0)=1/п 
Var (Xj) = E(X;) - E'(X,) = (1/n) - (n?) = (a- D/n? 
E(X, X,) = V/n(n- 1), Cov(X; X,) = [1/n(n- D] - (0) = 1/ п? (п = 1). 


Notice that X, X, = 1 iff card k falls in cell k and j falls in cell j, the former with 
probability Un and the later with probability 1/(л — 1) ; and in all other cases X, X, = 0. 


If S denotes the total number of matches, then S = X, +X, +... + x. 
EOS ЕС JEG.) +. TEAL) = nE(X;)=1 
Var (S) = Var (X, +... + X) = È Var (X) + 2 È Cov (X, X), j>i 


= 26D о (Ja Аа 
п п? (n— 1) п п 


5*, Let X, = 1, if ith ball drawn is green, X; = 0, otherwise ; i= 1, 2, ..., k. Then, S, = X, 
+X, +... + X, is the number of green balls drawn. Now 


Ene — P(X, ==) Е(Х,)=Р(Х, = D-— EOD. 


Var (X) = [m/(m + n)] - ine 4 ys = mni(m +n). 
To compute Cov (X, Xj, i + j we observe that X; Х, = 1, if both ith and jth balls drawn 
àre green ; otherwise Х, X, = 0. Hence 


E(X, X) = P(X, =1, X; = 1)= Р(Х, = 1) P(X; =11Х, =1) = [m/m + п) 0н - Vm + n - D). 
Cov (X, X) = E(X, Х,)-Е(Х)Е(Х,) 


т(т — 1) -( m ) А -mm 


= (m+n)(m+n-1) m+n (ma) (m*n-1) 


E(S,) = kE(X,)=mk/(m+n). 
Var (5,) = ХМаг(Х,) + 2E Cov (X, Ху) (i*J; i, j212,., K) 


үче ч] 


72 2 B Solutions to Starred Problems 


kmn — И тп T тпк (m ^ n — К) 
2 (m +n) (m-n—-l (m+ п)? (т+п— й: 


6*. Let the numbers appearing on the 7 successively drawn tickets be X,, X5, ..., X . 


These are jointly distributed. Now 


(m + n) 


Var (5,) = Var(X, +. „+ X,)= È Маг) +2 Im X,) Ti 


= | 

Observe that 5 = (EvN; e?-Z(w-v)!/N- (у? / М)- 0). 
Now Var (X) z90,1sjsnz12,..n Further, each of the "C, = n(n - 1)/2 pairs of X. 
has the same joint distribution and не {һе same covariance (say) Ө. Thus, (1) provides 

Var (S,) = no? « n(n-1)0, nx М. 
To determine 6, employ a trick : take n = N, so that Sy = EX; = £v; = const. This 
means Var (Sy) = 0 and from (2), we get 02 —o^/(N -1) and thus (2) begets 

Var (S,) = no? - [n(n- ) à? /(N - D] = (90У —0)/ (N - ylo?. 

Var(X,) - Var (S, /n) = (1/п?) Var(S,) = IN — п)/ (М – D] (o^ /n). 
The factor (N — n)/(N — 1) is the correction factor for sampling without replacement 
[Var (S,/n) = с2/п for the case of sampling with replacement] 

Corr (X, X,) = Cov(X;, $,)/ / Var(X;) Var(X,) = —1/(N – 1). 

Note. If Vix j then o? = (N? — 1)/12, since v = (№ + 1)/2. 
——M APPENDIX D. Sec. D-5. Page 259 ——— 


1*. For the numeral x, = k, the weight w, = k. By definition, the weighted mean is 


_ Iwxgd Sk _n(n+l)Qn+1)/6 _ n+l) 
Ма” Xxx уу п(п + 1)/2 w xm 


2^. E(X) = EZ(x,/n = (04 29... n)/nz(n* 2)/2 
EO?) = Ух2/п= (12 +22 +...+п?)/п= n(n 0) (2n+1)/6n 


Var (X) = E(X?) - ранена RR 


Remark. For a Die distribution, п = 6 so that p = 7/2 and с> = 35/12. 
3*. We are given that, if k is some constant, then 


р. = Р(Х =ғ) = К("), 150,1, 2,..., ^ 


1 = Хр, кх(")= 1+1)" =k. = k= (1/2)". 


OO ~ Solutions to Starred Problems 723 
E(x) = arp, = КУ”) T "Y |) = nk TEN ES r 72" «n2. |(@- а ("- iJ 


E 2 pe n 
E(X) = Er p, =kE [rr -1 +r](”)=kna- 1)2"-? + n2" !]2 п(п + 1)/4. 


Var (X) = E(X?) - E? (X)-n/A. 
4*. (Ух), = Corrected Xx, = Xx-x 4y-T-x y (1) 
x, +), 76 


2 
(Xx;), = Corrected Di) -Eg-2vy Р) 
Originally : 6° = (У х? /п) – [ZEx/nJ^, which provides (Zx2)/n- 6? + (T^ /n). ---(3) 


Let o be the corrected variance, then using (1) and (2) 


в} = Corrected ( х? /n) — [Corrected ( x, /n)]P = (Ex? х2 + x/n] - IT — x, +y)» 


T y -e [T 2 
a a ied © l ежи a 
n n n n 


5*. Let the values of variate X Бе x,, x5, ..., x, and let 

Q, = [(x? + x! +... + х") n] "iV 
(a) Choose p = | in (1) to get 

Q, - TATE NES: (the arithmetic mean). 


(b) Choose p = -1 in (1) to get 


uve ier аыр Ч 
Ba Жу лы p Зр: (1/ x, +1/x, +...+ 1/x,) 
Obviously, Q , is the harmonic mean for the variate X. 


(c) Taking logarithms of both sides of (1) we obtain 
бп[(х + af {ое x?)/n 
EN on 
When p — 0, tn (Q,) is the 0/0 form, hence using L’ Hopital Rule 
: x? nx, + xf nx, +... пх, ` Ün x, t Ün x, +... + Un x, 
(0) = „з (x? +28 +...+ Ха) п 
" the geometric mean of X. 


е 


Toms in(Q,) = n(x, о), Qo = (%1 X» Sa 
:Q,=A,Q.,=4, Q = С. 


| "7 


724 Solutions о S tarred Problems 
TE A b = max (x, ..., E thenr-b-«a 


-(Ex,/n)2a; and so 


6*. Let a = min {х}, 


Now x, 2 d, V, hence a 
' y | 
x) snr’, 15/®лЛ 


x,-xX<(x%,-a)s(6-a=r > L(x; 
As (n- 1) $? 2 n$? =X (x, - x)’, it follows that 


(n — D$? «nr => $ < r[n/ (n — Dni ‚ nS’ < n^ => S<r 
Chapter 7 : Conditional Expectation 


Sec. 7-50. Page 278 —— —— 


1*. Marginal density : f(y) = Ly e" е“? dxze?, 0«y«o. 


Куре" 
ЛЕ). fh) ў 


ea -Xly 
| uli а X Ще = 


So E(X | Y= y) = E : 
y y 417 y^) 
2%, Let f(x, y) 2e ВР x20, y x0; f(x, y) = 0, otherwise. 
ы. ] 
pid= x i B" are Sse”. |ro іх) = cay 7 xe" | 


mro І ba 


ў у) = 21 e *»q 
юе t de»! Qc»? 


; dy > 0, [divergent integral] i.e. E(Y) does not exist. 


n Lente = 


E(XY) = [ J y. xe" de dy = К xe ах |" ye? dy= Ѓ > 2 6-х Ч ax = Ё ed 


E(YIx)- L y.f(ylx)dy- kk. ye ? буы e i 
x x 


Thus, both E(XY) and E(Y | x) exist, although E(Y) — oo. 
3*, We write E(Y | X) = py, y, and use conditioning : 


2 
E([Y - 00) 1 X}= EC — yix) + (yyy 7 80) 1X). [Use Binomial expansion 
x EU - n4) IX} + 2E((Y — рик) (ui - g(X)I X) +E{[kyix = ВОО] 1x). 
E(Q - uyix) (их - &X)I XJ = (них -80011 X] EY -EQ'130] = oQ0 EQ) - E02] 7? 
Е (У - gQOY 1X) 2 E((Y - n4)? 1X). ,U 
Taking expectations of both sides of inequality (2) yields result (1). 
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* Let X be the number of r; igi 
"2 random digits to be generated until 3 consecutive zeros 


ed. Let Y be the - pho 
are сиг i А е number of random digits to be generated until the first non 
zero digit 15 О tained. Then by Double-E Rule 


EQ) = E(E(XIY)) = Ej] = EY =jPIY =) 
j=l 


3 
LOW = PY = j+ So =/ PY = j) 
| j= 4 


> 
3 
. К о x 
= iP? 10 
1-1 3 1l EP А 
Now SP 2G = 3pg!—— = 34° = 0,003, Y pal! = p(1--q +47) = 0.999 
К 1 


3 
, f=) 
p\ dia | = p{l+2q+3q7}=0.9(1+02 + 003) = 1.107 


E(X) = 1.107 + 0.999 E(X) + 0.003 = E(X) = 1110. 
5*, We must determine f,(x) : 


ДО) = Гу) = J, 6 dy = 6(x — x°), 0<х<] 
f(x, у) | 
ARE fx e» "Oum Our 0<х<1. 
x a 1 а-а‘ datt) 
- = .ydyz — dy = — = —. 
Е(Ү!Х=а) = J. 7010). уф= [; » dy ibt nM 


E(Y) = Ea xy - e| хох + |= [ea 95:0 necs 1-2) = 5, 
6*. (i) Conditioning on the values of Y yields 
p = PX <Y)= [^ PICGODWY = у} KO ф = |, PX < у) HOA 
= (f. ooa) 0) = [ 0) 004. 


(i) PUX4+ ¥<a} = f; PIOCHY) «aW 21,004 [PX <а-) HO y= [; Fa Why 
nd Y and more that probability p = 1/16 for each 


7*. We enumerate the values of X a 
Outcome w = (х, y). 
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(A) (B) 
(a) Table (A) reads the joint density of (X, Y). Let P(X = x) = (х) ; 
then, ЛО) = fi) = f) = }(4) = 4р = T. 


Similarly, PŒ = y) = f). (1) = p, f2) = 3p. £3) = 5p. f(4) = 7p (marginal totals) 
Since f(2, 2) + f,(2) . f,(2), it follows that X, Y are not independent. 


(b) Let 0 < є < p. Then, the joint density g(x, y) shown in table (B) has the same i 
апа f, as in part (a). We thus note that the joint density is not uniquely determined 


from the knowledge of the marginals. 

(с) P(Xx2,Yx3)-zf(l, D) К 2) + K1, 3) + Д2, 1) + f(2, 2) + f(2, 3) = 6p = 6/16. 
(d) E(X) = 4р(1 + 2 +3 + 4) = 40р = 5/2, Е(Х?) = 4p(1 + 4 +9 + 16) = 120p = 15/2, 
E(Y) = p(1 6 + 15 + 28) = 50р = 25/8, E(Y)) = p(1 + 12 + 45 + М2 = 70р = 85/8, 
E(XY) = p[(1 +2 +3 + 4) + (8 + 6 + 8) + (27 + 12) + 64] = 135p = 135/16. 


7. Var (X) = 5/4, Var (Y) = 55/64, Cov (X, Y) = 5/8, Corr (X, Y) = (5/8)/\/574 .55/64 =2/ 4/11. 
(e) Observe : f(y | X = 2) = f(x, y)/f,(2) = 4fQ, y). 
$o,f(112) 20, f212)28p, f(312)=4p, f(412) = 4р. 

E(YIX = 2) = Ууу | 2) = 16р + 12р + 16р = 44р = 11/4. 
8*. For discrete variates X and Y, E(Y | X = x) = È, y fy |x) = У, yf (у) = E(Y), since by 
independence f, у y (y | x) = f(y). If variates are continuous, 


E(YIX-x) = f. уух) у= | yf,(y)=E(), as before. 


Converse. Let X and Y have joint р... fx, у) = l/z, х? + y ©] 
The marginal densities of X and Y are 


f(x) = 241-x!/n, -1<х<1; fo) -241- ут, -1« ysl. 
Obviously, f(x, y) # f(x) fy) => X and Y are not independent. 


Now f(ylx) = "си ee ац -41- x? «y«J1-x . 


— ——— — 727 
КОЙ . — — MESS Р 
E(Y Ix) = | у (уі х) ау = Г, ы 14% a a 20. 
БР. 


[Odd integrand] 


І 
Е = VJy ly = 2 | А 2 
Further, p J, Y 9d T [ »Ji-» dy =0. [Odd integrand] 


p ES E. E^ although X and Y are not independent. Thus, if X and Y 
medii (X I Y) = E(X), E(Y | X) = E(Y). But the converse need not be true. 


9*. By normality, 1 = Ур, =10р > p- 1-01 
ЕЕ. E 


10 

The row totals and column totals in the adjoining table provide the marginal distributions 
Р(х) and P(y) respectively. Thus 

X CONG 0 | GENER 0 

ШОО po 4 ар | PG) : 2p 6p 2P 

E(X) =-2p + 0+ 4р = 2р = 0.2; E(Y)=-2p+0+2p=0 

EQ) = 2р +0+4p = 6р; E(Y’) = 2р +0 + 2р = 4p. 
-. Var X) = EQ) — EX) = 6p — 4p” = 0.6 — 0.04 = 0.56; Var (Y) = E(Y)) - EY) = 4p - 0 = 04. 

E(XY) = -p + p = 0 (From table, omitting zero terms, seven terms contribute zeros) 

Since Cov (X, Y) = E(XY) – E(X) E(Y) = 0, X and Y are uncorrelated. However 

P(X = 0, Y = 0) = 2p, P(X = 0) = 4p, P(Y = 0) = 6p ; so P(0, 0) + Px(0) . PKO). 
Thus X and Y are not independent. 


Р(Х=х1\У=0) = Р(х, O/P(Y = 0) = P(x, 0)/6р 
P(X2-11Y 20) = Р(-1, 0)/6p = 2p/6p = 1 
P(X201Y20) = P()0y6p-2pl&p 1 ; Р(Х= 11Y 20) = PCI, Oy6p = 2р/бр = 3 


Again f(Y1x) = Дх, у)//(х) ; so when x = -1, fy | x 2 -1) =f(-l, y)/2p. 
E(YIX 2-1) = Ly fO |x= -1) = [Уу SCL, у)]/2р = [0 +0 + 0]/2р = 0 
EQ? 1X 2-1) = [Ly fl, УР = [0 + 0 + 0]/2р = 0 

Thus, Var (Y1X=-1) = EY 1X =-1) - [E(Y! X = "DJ s: 


10*. Firstly we check up normality : 


[ f(x, у)ау = e*fa-e ard) [е dy=e"(x+e*-lt+e“(-e")=xe™ ..(1) 


(| [Ро у) dy dx = L x27! e “dx =T(2)=1. 


This shows that fo, y) is a bonafide density. As a by product, (1) yields the marginal density : 
| П-р x «o M 
Byaymmery: 0) = ye?.0<9 <2 20) 


0 < x, y < co, has the same marginals f,(x) and 


git joint density g(x, y) =f) L109» 
^) as does Дх, y). However, fx, у) # g(x, У). 


af yj 


pu T" 
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(а) f(v lx) = Дх, у)//|(х) = e . Й, у)/х. 


\ 
e-l)m - m a 
iae f ye ) dy + - Í AU G í ) dy 
X z= A $0 


p ео +y) tiy +e (1+ »| = | «| 3 | 


E(Y | x) 


(b) p = P(X <2, ¥<2} 
= ah. het Fix, y) dx dy + |, AM f(x, y) dx dy 


p= fa ~e*)dx fe^ dy + [е = dx [A - e7*) dy 


= fa "8 (e е) dx+ ре“ (xt e -Ddx 
т b [x *e?)e* -e?]dx = (1- 4e? - e). | 
(c) E(X)= [7 Ge) xdxerQ) 22; EQ) = бё Әл dr =T(4) =6 
Var (X) = E(X) - E(X) 26-4 = 2. Var (Y) = 2, by symmetry. 
E(XY) = | ye" dy [x07 e) dx | хе" dx |, 0-67) ау 


a ye? dy [ x(1— e *) dx [2nd integral = Ist integral] 


oo exsul E Por aem Es 
i| tye [Sy +e а+»-1]=[ e" [y +2(у+ y) e? – 2у]ау 


(a) Г(2) +2. (2 ) r(3)- 2.TQ)-s 5; 


\! 

=J 
~ 
+. 
М2 
Еб 
ә 


Cov (X, Y) = E(XY) -E(X) EY) =5-2х2=1 > руу = sot = 
X tuy 


Note. E(E(Y | x)] = Е[1+1х|=1+2Е00=1+2@=2=Е(Х) = Е(Х)=Е[Е(Ү!Х)]. 


11*. Selection of two random points on the 
boundary of a Rectangle a x b gives rise to the 
following unique disjoint events : 

= {Both points lie on the same side a}; 

= (Both points lie on the same side b}; 

is = {Points lie on opposite sides a}; 
di = {Points lie on opposite sides 5]; 

= {Points lie on adjacent sides}. T 
ма 25 = 2(а + b) be the perimeter of the rectangle, then the measure of length available 
to choose any point on the boundary is 2s; and measure of length for the specific 
sides is a or b as the case may be. 


Solutions to S tarred Problems А 2 9 


^ (£ | rJ A га l | 
po 2s 25/ 252 PA) P(B) = 2| > | 3 ? P(B,) P(C) s[ T | _ 2ab 
— РА ^) % ^ 2 и 
is the distance betw | = Pip бы 
If Z 1s ance between the two Points, then 
ЮЕ | | f(x, x,)(x, — + \2 7 | ! 
[ | ш 7229 — a)" dé dr, = n І І (x x) dx, dx, = 5 - 
E a 6 
EZB - =. 


2 É ] а ph 2 4 
EZ 10) = -zh [x ty dx dy=1(d ep) 


2 J, 

EZ 1A)- EW * 0, -X] =? «Eon -X= 6) [by (1)] 
2 [b 

EZ!B)-a EL ) (а = Ь) 


The total expectation of the variate 22, by Total-E Rule is 
E(Z) = ZE(Z*1A) P(A) = (2) [a^ + 4a?b 6a? b? + Aab? + b*] 


^ (a + b)* ON 


s (a+b) 
6s? 6. 61 — 


Chapter 8 : Generating Functions or Transform Methods 


Sec. 8-19. Page 291 


1*. If t=0 then M(r) =E(e*) = I; but M(t) = t/ (1 1) 2 0,at t = 0. 
Hence, #/(1 — г) cannot be a m.g.f. of any variate X. 
н inh at 
* EN D wf s rud ot zur, sm 
2. Mosk) -&e-[, deo ule 6I 
The power series for M(t) and sinh ar provide 


ip^ | o0 (at)"" 1 


4 d к. = (ar = ae . 
ун, =a rad! AQ» Ог+1) of 


Obviously, u = E(X) = Coeff. of t = 0. This shows that the simple and central moments 
аге identical. Further, there are no odd powered terms it t, hence p,, , = 0. Equating 
Coefficient of P" (2n) ! on both sides in (1) provides p,,/(2n + 1). 


3*. Here F(x) = 0, when x < 0, F(0) = у; hence P(X = О) 1. 
For x » 0, f(x) = F'(x) = le". The Dirichlet's form for m.g.f. is thus 


2-t 
э 


о =X IX FE 1 
M,(t)= Ele”) = te’ +f, те e dx = 2231-5 2dedf 
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4*, Mq) - X wi =1+ T L-(0.6) = (0.4) + (0.6) У ^ = 0.4 + (0.6) e' 
mera ral r: r0: 


Since M(t) = ХР(Х = k) e" = R0) + Д1) e + f(2) e+ ..., 1, 2, ..., it follows that 


P(X =0)=0.4, P(X =1)=06, P(X22)-0. 
5*. Twice differentiating M(t) w.r.t. parameter t, we get 
М'(ї) = ст'(т) e" ^P. M''(r) = се" P im" (t) + cem”? (r)]. 
Now E(Y)- M'(0), E(Y?) = M''(0), E(X) = m'(0), E(X^) = т''(0), m(0) = 1. 
EQ) = cp, E?) = EQ) + cp] = do? + i?] cj? => Var(Y) = Е(У?) - с?р" = с(с’ + г) 
Aliter. Using exponential series we get 

M(t) = emt iine o c[ut t+ bust? +...]+ ic^[ur + lyon $e] 
E(Y) = Coeff. of t= cp; E(Y?) = coeff. of 1р = ср + ср? 

Var (Y) = Е(Ү?) -E (Y) = си’ =c(o? +p’). 


6*. M(t: Х)=Е(е") = |" f(x) e" dx + x p(x) e" 


мо) = sr fre 0h Nd E X98 EG 


-l(-An'«le*e"-ig-Ay'-ie MERET gen (1) 
To find Var (X), we utilize series expansions to obtain 
M(r)s 101+ А XP +. HEUEA HE ++ $V tte +o) +...) 
u = Coeff. of t = A; р, = Е(Х?) = Coeff. of 11° = (332 12) + (А. /2) 
Var (X) = p, - (uj)? = 27 + А). 
Note. M(t)=+ mg.f. Expo (X!) 1 т.р.Ё. Pois (A). 
7*. By Multi-Stage p-Rule, we have f(x)- ple! ! J2x is. dro / 42x). 


-1x? -lo- 1)? 
M(t: X)=E(e") = р] e" —dx + qf, е" © 
Me Ede. dog. Oe) тур 
= p[m.g.f. №, 1)] + gim.g.f. N(1, 1)] = pe”? +ge"*". 


To find Var (X), we use exponential үчен; b Thus 
M(t)= pil + 18 +...]+ 4{1+ 160) 1 +10) +] 
E(X) = Coeff. of t = q, E(X^) = Coeff. of 1t? = p + 24. 
Var(X) = E(X?) -E'(X) = p+ 2q - q? =1+ pq. 


EE Selution; to Starred Problems 731 
——— Sec. 8-46. Page 302 


1*. We find Yo by Normality : Yf( x) 


= 1; so 
1 = у [е xlo РР 17 
Jo}, € = “бу > у, = 1/6. 
(1/с) gv vo 
To find quartiles, we use definition to secure 


bud Q, ewo 5. 2D. fu r 
"mr M dx-l-et = Q, --ctog(1- 7.) 


To find k, we first determine m.g.f. : 


-x/o 


ub Ix a ^ 
M(t) -E(e^) = f JW dx = 3" maa WK 


o 


zi = (I- ot) ',(It1«1/0) „А 
o l-ot 


= У (ot ом ето )= B [by Bin. expansion] 
Thus, р’ =r!o’. 


Also, K(t) = № M(t) = -ln (1 - ot) = POL. -X5 (r- D!o']- X LE. 


rel r= 


9 ува, 
This gives, , = 0, k, = p, 20^, k, = p3 = 20°, k, = 6o* 


E. ag k, + 3k Y А 
So pei .19 4 ==. [B, = a,, B, = a4) 
ко o H2 2 


^ o ar war © t y o oid ; 
Tp t ле” ў - [Lin E] 


So K(r:Y)-0n M(t:X?) = (1+ EC py / r0), 1&r« oo. 


2 
ME a 
Ls r on "n 4, 2 а = 
b е] [не] re 
Equating the coefficients of t, Ü ‚г, ме get 


3 nel 
Aa ә} d Ay = He 7 ЗИ + 2(и,) (1) 


À =н J ? 
= = ky + 15kyky + 10k; + I5 [87-42] 


Recall : B =k, u, = ką = T ps = ks + 10, Не 
* 2 
43 А = К, A, = (ky +30) - 6 = he + 2o 
3 
M = (ke + 15kgky +1002 + 1543) —2ko (kg + 36) +26 


| 
| 
я 
“ 
"Ld 
"P “= 


= ke +20562 + 64) + 8o. [Putting in (D] 
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3*. We twice differentiate w.r.t. t the given relation to obt 
M'(t: X +Y)=My,(t) My (t) + My (t) My (t) 
М": X +¥)=My(t) М) + 2Му(0) Му) + M t) My(t) 
Setting г = 0, using M(0) = 1, M.'(0) = E(Z), M"X0) = E(Z°), we get 
E(X + Y = EO?) + 2E(X) EY) + E?) 
E(X?) + EY?) + 2E(XY) = E(X?) + 2E(X) E(Y) + E?) > E(XY) = E(X) .E(Y). 
This gives Cov (X, Y) = 0 => X and Y are uncorrelated. 
Comments. M9 (t:Z)- D' E(e”) =E(D'e”) - EZ" .e") 
The DUES by t is justified by the regularity of exponential function and the simple 
structure of the c.d.f. Fy. Upon setting г = 0, we get u, = M? (0). 
4*. We shall use m.f.g. technique. Now 
M(t:X, —p)=e "M(t: X) M(t: X;)=e" MX; — Һ) 


ain : 


M(t: Х) = [M(t/n: X) = e" [M(r/n: X; wine" + 3 Cia, [m.g.f. expansion] 


k(t: X) = М(г:Х) = ш + пп [1+ E(t /rtn")p,] 


2 3 
р. ,1|е т Н, 
ur цз 2 AS 2 . 
Equating Coeff. of t/r ! on both sides (r = 1, 2, 3, 4) 


k(x) =p, (0) = u, (х) = / n, k(x) = p(x) =p, Іт? 


3 2 2 
„= Me 30 = uh 39) = EAE ‚3: D) 


These are the first four central moments of x (about и) in terms of the central moments 


of variables X А Now : 


(n- DS? = У(Х, - X! = У(Х, - n -nX -pY - (X; – р) – (17 (XX, ЮР 0) 


= (ЕРУ (EPY Ins [Ү,= Х,- н] (3) 


Take expected value in (2) and use (2) to get 


(n—1)E(S*) = пЕ(Х, - p)? - nEQX - р)? = np; -nlu / n) = (п - Dp, 


Thus, E(S*) =n, se (4) 


Square (2) or (3) to obtain : 
(n—1)°S* = [E(X; -m T - 2n(X - р)? E(X; - wy? +n? (X - py? 


Solutions to Starred Problems 733 
4 (EY?) – (2/ п) (XY, ) (Z¥*) + n2(X – ц)! " м — 
pity; HEY E ]- Q/n)[ZY? + Y y Ү (EY, ) - n(X - y) 


rJ 


= n-o/ Ё 
[1 - 2 / n] (У, EY OA FAN YY Y?) +n?(X —- н). 
ї# j i*jzk 


We take expected value of both sides, observe that Y, and Y, etc. are indep. and that 
Е(Ү,) = 0. This gives 


2 
(n- 0) E(S") = (d - Q/ nMnp, + n(n - 1) (EY2) + пц, (х) 


(n-2)[n, + (п – Di] (a, 332) п, +3и;], [by CO] 
[(n — D? / n] py + [(— D/ n]? – 2л + 3] p3 
E(S*) = (и, / n) + [07° – 2n +3)/ n(n - D]? 


EF 2 
Var (S*)=E(S*) -E (5) = Ea p АЫ. 
n i 


(b) Cov (X, 52) -EKX — p) (5° — n] = E - н) S - p(X - p] = EK – 1571. 
Now (n- D(X -198? = (X -j)[E(X; -m° -aX - i). (Бу Q9] 
= (EY (ХҮР) /n- nX - и), [by (3)] 


- [£5 - zn; |/п-щХ- i). 
zz iz] 


Take Expectation, use E(Y,) = 0, use и;(х) from (1), to get 


gd чао Pants 
m EET п— 1 n n 
Note. We may also use the following in the above solution. 


У(Х, -Xy- ZIX, ~X)-(X,- ХР = 21% -XP «(X; - XY - XX, - X)(X, - Xy) 


Cov (X, $?) = 


-nX(X, - X)! e nz(X; - XY - 22% - X) (X, - X) = 2nZ(X, - Xy! 22n(n - 1) S°. 
Thus, $? = EE(X, - X; / 2n(n - 1). 
———— Sec. 8-61. Page 311 
I* Ege [ent dee PEED = Fs E0073 L EQ)» 2, Var (X)= 55 


= Р(пһ< X < (п + 1)h}= ы soi vtri [Ah = 20]. 


. 
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ШО с nn ———— - 


-À nh (27+ DAI? = = (1 4 tud j^? У (е 


G,() - Et") - 07 €?) e — 


п=0 


20 7" y 


— (1 аур (1 Ыр??? yy”, 


To find moments of Y, we use logarithmic differentiation of G(r). 


CONT iani mum К ө |! 8 | 
oa ar => EY)-G'(75 TL ELE гапе ЈЕ) 


1-67 


Since 0 « tanh 0 < 0, we readily obtain E(Y) > E(X). Further 


-20.h а h s 1) (1 bs a} [^ а. he ®t” -2 | 
отоо TET коо [ede Уч 1 o | 


laen 
-204 ,-20 2 -490 -20 
уе h 2 (e +2he~ -]) 
2a coth“ 0 + a 


-20 i 
h he ем 1+е 


h 
G" yi n 
С") койы + 2 dae TE 
zw ЖО LN) eel Yl 
Un CIR susc alia e")/ 2) ~\sinh®) 32 


= (0/sinh Ө)? Var (X). 
Since sinh Ө > Ө, Var (Y) = (0/sinh ө) Var (X) => Var (Y) < Var (X). 


2%, Let the ticket bear the number Y,Y,Y,Y,Y;Y,. Obviously, Y/'s аге 1.1.4. variates with 
PY, = k) = p = 1/10, 0 < k < 9. The p.g.f. of Y/'s are indentical, each equal to 


G(t: Y) = 0/10 014...) 0/10) 1-2") / (1-7) 
So, G(r:Y, +Y, +%)=(1/10)' 0-1?) (1-0 = GY, + Y; + Y.) = GO), say 
PY, +Y, +1, =ғ) = Coeff.of t" їп С(т); PY, +Y; +Ү = г) = Coeff. of t ' in С(г') 


PY, +Y, +Y; =Y, & Y, +Y) = Coeff. of 1° in G0) .G(t ) 
Coeff, afa? in (1/10)5 10) (1 — 0€. 


p 
So p 


Recall Neg-bin Thm. : (1- х) = d D orc012.. 


Now, (1-1'°)° = 1-(6)," ZH +..5(1-1° =1 «(Se (D)? а) yr 
ООА 


3*. The generating function for one throw is 


Gr: = Lester LS )- са -15)0-1) . 


_——— — Solutions to Starred Problems TOO 
Since the throws are independent. with 5 


Git: 5) = Gr: X, + X, +... 


identical distributions 


*X)-[G(: X) =" a-i5y (у /6". 
E Bis {n)a | 
= =l- + E. n n+1)\5 T" 
E e| (i) (3) Jis ) pese. (n dia |) 


P(S=n+5) = Coeff. of ^*^ in (1) zu З у (2) 


Р(5 =п+ 4) = Coeff. of t"** і (1) = C И j (s) 


Comments. We juxtapose the infinite series in (1) 


Git: S) = 3 -È ("усе У lee als 4 BS y у ү; Jar ) (ye _ (А) 


k=0 j=0 k=0 (6)" 


To find P(X = r), we put 6j + п + К = r, and (A) gives 


EN Ы nl mir —- Gia) EC S. 
rien EEN) PO. 
4*. Let G(u) = Lp, u‘,(0<k<~) be the p.g.f. for the distribution. We multiply (1) by 


и and sum for all values of k, [Eu^p, , =иС(и)] taking p, = 0, for k < 0. This gives 
dG(u)/dt = Ми — 1) G(u). 
The solution of this variable-separable differential equation is : D) e Cae nh 
Since the set of events is complete, С(1) = 1 — C = 1. Thus 
G(u) = e" ее“ e Yu Ir, (0<ғ < ә). 
= Coeff.of i / k12 e " Qa) ГКІ. 
s Obviously, P, 2 0, iy 
© Р" Ру». © E (x; Y 7 
2 ласы - р "у= X pul 
k= = int /=0 k! j=0 k=0 
It follows that P, is a p.m.f. of some r.v. Y; in fact bat = P(Y =k). Now using (1), 


РА о © x P - -Xj = ] а = i Ix, 
Gir: y) = Eq") - Y, Riti p врет - ре 2 i У, рее! ...(2) 
k=0 j=0 k= 


This is the generating function for the distribution (у, Pj). Now 


Бою = G'Q)- [Z p, e "x, €. =P; x, EOD. Qs j« =) 


ИХ, |Erv? / 
G"() = [Ep,e "xj e "1 = EP; =E) (0<ј<ә) 
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Var (Y) = G"(1)  G'(1) - [GDP = ЕХ?) + ECX) E*(X) = Var (X) E(X). 
6*. G (1:Z) = G(r:X +Y) «O0: X). GG :Y) 9 [p/Q - qo]Ep' / (1- а'т)) 
= $-a Y. adt Fy - Wm g 7 Jr | 
1—4! 1-41} t 


q-4 4-9 r= 


t EP. ЕГ". [г=1+К] 
4-9 k«0 
PILAR = pp'(g *  «g**')/(q-4), o 4*#4 


ГА 


Chapter 9 : Characteristic Functions 


I(n+r) (n+r-1)! fos Aw 
ж. * ü | 
; T(n) (n - DI | EDLE 
$0) = X aE [te ly agli 
Fou OM 1. kx 


2*. In case c.g.f. exists, it is given by 
ки: х= X Ek =F ©-(-1ул=п y, E - -ntnnd - й) 2n - ity”, 
rzl n rz] Hn r=0 T 


Since K(t : X) = no(t: X), it follows that ф(7) = (1 — ау 
3*. The constant y, is determined by normality Y f(x) = 1. Assuming that the given 
law is p.d.f., we get 


p^ = Е(Х") = у, Lr. "Rm (1) 


If r = 2n + 1, then the above integrand is an odd function of x, so that Н», = 0. In 


particular, р, = p = 0. If r = 2n, then the integrand in (1) is an even function of x, and 
since the central moments are identical with simple moments (as p = 0) we get 


TAE P n е" x" dx=2yy Fe nl edi Dy. T.(2n-4 1) 22ys (2n). 
To determine yy, we use normality Y f(x) = 1 = ц, so putting n = 0, we get 1 = 2y) > Yo = 1/2. 


From р,, = 2n ! we get o = р, = 2 so that S.D. o= J2. 


M = E(Ix-00 2 f Ixle а | xe" dec TO = 1 


E (e^) => [5и e" dx = 5 i e! (cos tx + i sin tx) dx 


фа) 
[e" (— cos tx + t sin „ү | 


(1+17) Df 


"o - 
f e ^ соѕіх ӣх = 
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—À Sec. 9-81. Раре 337 


1*. ф,(—1) = 6,0) => (n) is not a Ch. Function, same is true of $,(1) . We may even note 
that ф,(0) #1. Since Іф, (1)1=2 < l, $,(r) is not a Ch. Function. Also $,(0) — 0 so that 
ф.(0) + 1. 


=i) is the Ch. Function of discrete distribution f(b) = f(—b) = 5. 


"NOE 1 (е? +e 
$,0Q satisfies Bochner's test whence it is a Ch. Function. It is Ch. Function of Lap (1, 0) Dist. 


$,(r) is Ch. Function of the degenerate distribution P(X = 1) = 1, P(X # 1) = 0. 


it + | е! РЗ | it | о f] ic AEN 
*. t) = =: =e = » ]l-— = c e" LAT E (3) la М а 
2 фу ( ) 2 - е! 2* 2 2 2 2 2 2 JE ( ) 


Since $(t) = E(e"*)= У) e P(X = x), we find from (1) that X is discrete with p.m.f. 
r=0 


+1 r 
P(X=r+l) = (1) 020, ie px -n-(1) rel. 
3*. By Inversion Formula, the density f is 


Ge же i TES 29 Ame. 
f(x) = Eu e o(t)dt= = [е (cos tx — i sin tx) e 


=н й 


+ [соз tx e dt [Even-odd properties of definite integral] 


{e™ [—A cos tx + t sin ix]. ^" N 


El Io EAS EL ———, – 0 <х < %. 
n (А rx) TA -x) 


, 


4*. Here fix, у, и, у) = f(x) fO) (и) fav), where fe) = (От). exp (-t? / 2), — oo « t « oo. 
It follows that X, Y, U, V are i.i.d. М(О, 1) variates. Firstly let us find Ch. Function of XY. 


буу) = Ele!) - EEG 1) -E (Ch. Function f of NO, 01) (е ) 


Aw 
-1p wj € 
a= dw 


"н ga UR ke 
"* JR 3 1+2 0° J2n 1+2 


ф(1: ХУ +UV) = à: ХҮ) фи: ЈУ) = V (0 07). 
This is known to be the Ch. Function of Laplace variate, whose p.d.f. is given by (1). 
Note. We can use Inversion theorem to obtain (1) from (2) or we can find the Ch. 
Function of Z from (1) to obtain (2). 


2 


ҮҮ, =w] (2) 


di 
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5%, ф (f, t5) 2 Eo!) Ее 7 a E (pet? IZ А 2} [Ву Double-E Rule] 


= E (Efe? eo (Z = 7] -E(E e?" 17 = 2) (Е e" |Z = 2) 


- nz Anz METATA 
cL ie ri? e oe] 


І 1.7 1002 +12) 22 1 г E 

o 12 -HR +N * 2 2 
— | agile” D atiis dz = —— | ———— [Дн + = и 
emo "PT APR TEC 


о е 1 
(1 +t Md | sine area under №0, 1) curve is unity : 1 Е € = | 


1/2. 


0011.0) = $,(0 = (15-02), ф(0,2,) = 6,0 = 065) 
Since ф (1, 7,) = ф(7,,0) 0(0, 5), the r.v.s. U апа У аге not independent. 
6*. Неге Rect (0) = 1./(101«1/2) - 0.7(101» 1/2). By definition of Ch. Function 


(t 7 ) T" i I f(x, ер » dxd a 1 SR e"™ AET But" e dy 
1772 -0 y pe an n/2 Ра 2 < 
Put y = z – x, dy = dz, then using e? = со$ Ө +1 їп Ө the above reduces to 


л/? E 1/2 No prs 
4n$(t, t) = Í gi 7 dy T [p * X 4 grid 2] ge 


-n1/2 it 


af” cos (f, —t,) x dx. ie [cos (1 + t,)z + cos (1 — t,)z] dz. [by even-odd properties] 


Lt (ti Nen [pr AFE) T E [sin IE) i 
(f, 10) Е (1275 
4sin [(t, ^5) 1/2] 2cos (nt, /2) 
1-6 ча = 5) 


2) si d /2] sin (xt, / 2) sin (11) 
This, $i.) = cos (n5) sin[( t) T | AM | E em... 
$t, 2) (1-2) [(t, 2,) 9/2] фух (f) (xt, / 2) , by 2) (1— 55) (th) 
7*. By Example 2 (89.81 Worked-out problems) we record that 


fo) = (1-cosx)/x', xeR; $y(0-1-Irl, 1г1<1. TU 


Now, consider the discrete distribution 


P(Y=0) = 4, P{¥ = (2-1) т) -2/Qk- D! m, k=0, 41,42... 
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We compute Ch. Function of y 


ф, (1) = Е (e! ) | | - p е!" | ' 2 it(2k = bn 
= 42 y cos (2-1) ти 
9 ei (2k - 1): 
by considering (0, 1), (-1, 2), (-2, 3) etc. 
From Advanced Calculus, rec 


| 
5 [el y gl? 2 cos 0] (2) 


all the Fourier Series for function | ¢ |, 


4 Y cos (2k — 1) nt | i t 
k= 


From (2) and (3) o,(t)=1-Irl, Itl<1. 


We conclude : ў, (х) = }, (х), but фу (0) = ф, (7), for Itl<1. 


k-1 : Я 
8*. Recall from Trigonometry : У e^"! = aa WP oh be wth 
0, otherwise 


r=0 


Now, ф(ї) E(e'*) = a 3 p, € е!" се, b (22) = Y ein(2nrik) р p, 


n=0 1=0 
k-1 


A 2nr V Qninr/k _ v A ke MN. NE^ t: 
У ф E poe X e£ =k У P(X =n;k\n)=kP{X = 0 mod (k)} 


n=0 r=0 n=0 


This is equivalent to the result stated. 


Chapter 10 : Some Probability Inequalities 


Sec. 10-21. Page 349 


1*. If Z = (X — и)/с is standard г.у. then Chebyshev' s inequality is 


Р{171> к} < UR, or PLIZI « k} > 1 - (10). Here Z = (X ~ 50)/10. wi 
(a) Р{171> 3/2) < 4/9 (upper bound). (b) P(Z 2 3/2) + P(«-3/2) = P( | Z | > 3/2) < 4/9. 
(c) Р(121<2) > 1- 12i. (d) P(-2«Z«2)- P(121«2) = 2. 
(е) P(1Z1> 2/10) < 100/ => (100/7) > (100), і.е. г> 100. 
2*. By Chebyshev’s Inequality : P{IZ,1<tvn}21-(I/nt’) Т 
Let A, = (1Z, 1<tvVn} Recall Bon-ferroni Inequality ($1-55(5)) 
P(A), Ay, -... А, 2 EP(AQ - (n- 1) ...(2) 


AS per (1), P(A) > 1 - (1/nt”), using it in (2), 
Р{12,1< Vnt,1sksn} 2 nil- (04 n)] - n 185 1- (0/0) 


3*. Let E(X,) = р, Var (X,) = o^; then 
6u n(n+1)(2n+1) _ 
^ рех у В = 
р - Ej Èk EX) = int Ол +1) 6 


| E 
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6 Ieri. 
А ^no -——Ás k^ Var(X,) 
Var (2,) = s +1)(2n+ | 2, : 
360° n(n + 1) (2n + 1) Gn wnel) " бо? ч 3л? + Зп – 1 
30 5 п(п+1) (2л +1) 


~ [n(n +1) Qn + DP 
Now P(IZ, —E(Z,)l>e} < [Var(Z,)/e'].  [Chebyshev's inequality] Ts 
Since Var (Z,) > 0, as n — œ, (1) reduces to P(1Z, - ul» €) 0, e. Z, “> E(x) =p 
4*. Var (X) = E(X)) -Е(Х)=4 > o=2 

pPC2€«X«8)2P(--5«X-3«5)2P(IX-31«5) 
Chebyshev's inequality : P(1X-ul«c)21- (с2/с°) provides р > 1 — (4/25), i.e. р> 21/25. 
5*. Here E(X) = р=5, Var(X)=07/n=1/n, (c 210?) 
KARL core => P(IX —51«0.001)21-— (10) / n. 


ü*. Eran ec a) +@.у+0. + =0,E(X) = a? (1) (2) а= 0, 


2 
= Var (X) =E (X’) =, ie o=5 Now by Chebyshev’s inequality. 


P(IXI22o0)-P(IX-yul2a)s 1/4. 
Actually, p = P(X22o]-1- P(IXI«a]z1- P(-a« X <а) =1- f(0)=1-3/4=1/4. 
Hence Chebyshev's upper bound coincides with actual value and so the upper bound 
is attained. 


7*. Here E(X) = :cD-4($)0-(D$-70, EQ) 211-1. Va(X) - EX?) - 2 


By Chebyshev's inequality : p = P(IX—-gu12z2o)x6?/46? =1/4. 

Exact prob. p= P(IXI21)1-P(IXI«1)z1-P(-1«X«1)21- (6/8) = 1/4. 
The two result coincide; thus in general, Chebyshev’s inequality cannot be improved. 
8*. p = Ply -20 SX Spy *20]- PIX - u1&26]»1- (6? / 40”) -1- 1-075 (1) 
Thus p > 0.75 = p + 0.60. So there does not exist any variate X for which (1) holds. 
9*. Here С.У. = с/р. Hence by Chebyshev’s inequality 


2 
= | In 400 o? 4 
FUE REN d up TT I3. 
{ H Ш (0.05 u)? n y? n 
By hypothesis, 1 — (4/n) > 0.90 > n > 40. 
10*, P(X,21) = 1/(к+1)=Е(Х,), к= 1,2,3,... 


Var (X) = E(X?)-E?(X,)=[1/(k+ D]-1/(k + D? =k/(k +17 
E(S,) = EE(X,) = (1/2) - (1/3) +...+ (1/n) 
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Var ($) = уул i | 
(5, >Маг(Х,) = X([1/ (1 + k)] (1/(+ky]}.1: ken. 


Recall : lim [1+1/2+1/3+..+(1/n)-tnnj=y = 0.58. 


i 4 1 - 
lim (E (2) + (2). (2) dn n)'} = 1. [Divide (2) by фп n and let n > о] ...(3) 
Note that 2 (1/4) is divergent and У (1/2) is convergent. Now let, 


[Euler's constant] ...(2) 


Z, = (S, / in n), Ө, == EZ) = E(S,)/ (фп n), Var (Z,,) = Var (S,,)/ (фп ny)’. 
Obviously Var (5,) — 0 as n — œ. Since lim 0,21,so10,— 11 < 1/2 e for all n 2 no 


By Chebyshev's inequality : P(IZ, —6, I«1g)21- 4[Var(Z,)/e] ...(4) 
Now!Z, - 112 1(Z, -0,) + (0, — DIs(IZ, – Ө, 1=10, -11) [Triangle inequality] 
Since 10, — 1l « + €, for all n > ny, hence when n 2 n1 Z, -0,1« 4¢ 12, -Il<e, V n27. 
EN УО -$ cis] < PUZ, -11««) 


or P(IZ, -1l«s) 2 1-4 Var(Z,)/e?, V nzn, [by (4)] 69) 


Thus, as n — оо, and hence eventually n > ny, the R.H.S. of (5) tends to unity. This 
establishes (1). 


Sec. 10-41. Page 356 


1*. P(X2 t) = P(X*02(t* 0) PX o z(t - c ЕХ +0)? V (ct) = HC) T) 
where we used C-p inequality 810-30 (1) with g(X) = (X + cy. 
Now if p = 0, E(X +c)? -E(X^ + 2cX + c?)20? + c); so we let 


pee 15: (ЕЕ) ay (t^ - 2ct + 3с?) 
ф(с) 2+ (c ty ф'(с) = (c+t) , ф (с) Аде Д 
ерт?) A 
ф'(с) =). x Ce ф гъ 


а n 
Thus, фс) is minimum at c = o^/t, and min ф(с) = o /(c hi б, 
Now, result (1) is true V c ; it particular it is true for c = o't. 


P(X 2:0 < o! Ko? +1). 
2*. Let us write Cov (X, Xj) = 9j; ve 


Vat (Zp, X) = LECov (pj X, pj X) = LLP P y SLR PPS [810-14]  ...(1) 
1 i ; j і i 


Ny, УУР, pj 9,9; =(2р,о‹)(2Р/®›) = (Xp, б) (2) 
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From (с, -6,) 20 we get 9,0; «(o7 +04) and thus 
LInp50,5,IXn p; (о не) = уо) *EnLnei| КО; 23 
елй (1), (2) and (3) we get : o° (Ep, Х,) < (Урс): < p;o; - 
Taking positive square roots, we obtain : o (£p, Х,) < Z(p; o;) < (Хр; NU. 
Note. We have assumed that all the series involved are absolutely convergent. 
ar. Let Coy (х, Xj = o; Note that (б, -9,) > 0giveso;o; «(o + o). T$ 
Var (5,) = Соу (5,, 5,) = Соу (ZX,, ХХ)  ZZCov (Х,, X;) = 20; 
S LZ£O,0; «lZX(o? -*07)2nZo; [By Schwarz Inequality and by (1)] 

Thus, Var (S,/n) = n° Var(S,) en (Zoj), 1<ї<л. 
Remark. You may even use Mathematical Induction to prove this result. 

Cov (S,, X, , )) = X; Cov(X,, X, D $Zo;,0,,, €1 Lo; *0;,,) = 1[(2; 97) + Кс, 1]. 


4*. To simplify writing, we put Y = | X |. Since expectation of a non-negative quantity 
is necessarily non-negative, we must have 


О<Е(У(А + 19) = VEY”) + 21 ЕУ) - E^) i.e. XV, +2AV,,, +V, 20. [У = E(Y?)] 


Since this Quadratic in A is non-negative, its discriminant is non-positive. Consequently 
2 

| (Иль) S У. Vaio, 

Let a = m, a + 2b = n, [a + b = (т + n)/2] then this result provides the stated result (1). 

Convex Function. g(0) is called convex function of Ө if, for every pair (a, D). 


1 1 
"E (a+ J < |i g(a) + t| 
In the present case, using (1) : 
g|} (m n)] = їп Ey "*"?] «tn (EW) E^]? «1 On EY”) + On EY”) - 3 (2g(m) + g0) 


It follows that n ( | X I") is convex. 


Chapter 11 : Convergence. Limiting MGF. Laws of Large Numbers 


LL ase Ree acta Sec. 11-31. Page 370 — 
1*. M(t) = (q + pe)" = [1 ple - D] = | Aen] 


t В ра; | 
lim M,(t)= lim m Mh -e^*-9 [m.g.. of Pois(A) & by Euler's limit] 4 
fie n-»oo n 
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By Continuity theorem of m.g f., à —— я 


X — Pois (А) under stated conditions. 
2*. We work with standardized variate; X*-(X-— A)/ VÀ. Now 
^ d 


мі, JX = 3 dig ™ M T x) 2e exp [Ace ^? at) 
exp {-VAt + A(e — b! 


exp (—VArt A(t/ VX 1122 1 1312 +...)} 
exp (^ /2 + 0(42)) 


Il 


M(t : X*) 


Thus, M(t: X*) > e". [m.g.f. of №0, 1)] as A > œ. 
3*. M(t:X,) = (1- ИА)", [8 8-16(12)]. 


M(t:X,/n) = M(t/n:X,)- Me -t/2An)" 


lim M(t:Y)- lim(1—1/Any" = e^, [трі of degenerate r.v.], by Euler's limit. 


no noo 
Thus, the limiting distribution of Y is P(Y = 1/A} = 1, P(Y # I/A} = 
4*. Since M(t : X) = [pe'/(1 — qe], by $ 8-16(7), it follows that 


M(t : 2pX) = MQpt:X) = {ре?" /(1- qe^")y. 
Since 1 — qe" = 1-—q(1 + 2pt+ 2p^ +...) = p— pq(2t + 2р7 +...) 


M(t: 2pX) = (e"" /[1—q(2t+ 2pt? +...) > 0/0—- 20) asp>0,q> 1. 
Since (1 — 21) is the m.g.f. of x2, [88-16(14)], it follows that 2pX — x5, as p 0. 


Sec. 11-62. Page 377 


1*. Here E(X;) = p, Var (X,)=o". Let T, = X?+X24...4X2. So ЕТ.) =пЕ(Хү) =п[о? +p’). 
In a way, first moment of X? exists, hence by Khinchin’s WLLN; 


(T, In) - (X + X? +...+ Х2) n —9 EQ - 8 +H осе *o. 


bnr in 4 
en 1 3 n a 
2*. E(X,)= xr EP -x(i a а“ = (n^ ] 
1 
Since (n 4 = i 39 > 1, E(X,) is finite [Convergent hyperharmonic series (1/n)", p > 1]. 
Since (X,) are i.i.d. variates, with E(X,) « o , the WLLN holds for this sequence, by 


Khintchin's Theorem. 
kn 


© 1 
3* н = (r +1) "Peng etu T [P= | 
ere E(X,,) = Y,—7— T uw (hé eruit CST 1+7 


Eel S 1 
Bx) = bera Wm й (5 ah 


ee. 
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We conclude that E(X,) exists for positive r but Var (X,) does not exist. However 
infinite variance need not rule out the applicability of WLLN. We try Markov’s Rule | 


E r Ж < 1 
+ е Imc < со, 0 ` 
E(X,, l a E 2 Bv s 2 p 0 « 8 < 1]. 


Thus, the sequence (X,,) admits of WLLN by Markov's rule. 


4*. Let Y = n X, where X ~ U(0, 1); then 


k/2 


(ЕБ 
r 


Fy) = PY «y)- PXze7)- |, Idx=1-e”. fy,()-F'(Qz-e", y»0. 


E(Y) = Var (Y) = 1. The sequence (Y,), k = 1, 2, ..., is such that Y, are i.i.d with finite 
mean E(Y,) = 1. Hence by Khintchin’s WLLN, 


(Qn X,) — 
n 


24) =P. EQ): [m С, = 
n n 


or mG, —> 1, ie С, —2әе!. This yields c = 1/e. 
п+ 1 


ы 8 1 um | 
* Ss Ix = — = — et: TI 
2^ (D E(X,) = = Е(Х, +...+X,) =o: Hl o, 0*2 n) " 
As n — o, E(X,) increases indefinitely and there is no stability of the arithmetic 


mean. Further 


(0200 M PAg n(n + DOn +1) 
ei yo AET 72 


Obviously, (B,/n y +» 0, hence (X,) does not obey the WLLN. 


(ii) EE) = ait to since Е()=5[/+—2]= 


Var Y,-[- (7/12 = 2/3. It follows that variance of the variates Ү аге not limited by 


some fixed constant but increase indefinitely with an increase in n. It follows that ү 
will not converge to zero in probability ; i.e. (Y,) does not obey the WLLN. 


6*. E(X) = у - 1k - 1)? =0. Var (X,) -E(X, =4(2k - 1) +4 (2k - 1) 22k - 1. 
= SVa je YOk- Dig? 
k=1 k=1 


Since (п (В, / n?) - 0, it follows that for (X,)), the WLLN does not hold. 
T*. Here E(X,) = 3* 3:062. 3* 4-02. 0 1«k «p 


EU) «3*9 gg 421-1. 549. Var(X,). B, = ZVar(X,) = (2/9). 
As (B,/n’) = (2/9n) — 0 as n — ©, it follows that WLLN holds for the sequence (X 
8*. Here E(X.) = id ы zu -i (1 Р arny = i (1 ЎР ty М )7 | 97n-l * 222-77!) = b). 


So 
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EUG) = 201-2") +30127") e 27^ 57-1 4 3-2 4-21 


B, = Lo, -Z(]-2" +27") п-(1-—2-"у+(1/7у(1-8-"у, (1&r&n. [Use G.P.] 
ee UITÍTÀ 


n? Y п 2" 2 ове g as n — oo. 
It follows that the WLLN holds for the given sequence. 


9*, (i) We show that EX) < А? > E(X) < ©. Assuming X to be continuous with density 
f(x), we have using C-S in equality. 


- | м, gun + 9-3" - Var (X, ). 


EI = [И [x /fo9][/f65]ax |< f. foods. [^ foo dx- EGO) 14 A. 


Thus E(X,) « A, V k. It follows that the sequence (в?) is uniformly bounded, because 


o? = E(X?)-E?(X,)<E(X2)+E?(X,) «247. 


2 
9, *25 Oi. Osi Prisi [c; =9; EI с; | 


їм» 


Now Var(S,) = 


n-i " 
<2пА? - 44? Y, Pum <2пА? + AA (n- 1). 
iz] 


(S,) (6n — 4) А? 
ER eae 


n 


— 0 as n— c. Thus (X,) obeys WLLN. 


(ii) Var [1 (X, + Ху, )]= Lo; +в, +2рб, өрү L(o, +611) 
Vart (Xa + Ху), 


Pi £X,,)-1 EG + Х,,)|>в, +0,.1}5 OC RE a 


ШӨ Recall : Var (aX + БҮ) ao; + Рс? + 2abo,, «a' o; *b'o;, if o «0. 
XS. TX A 
os va (St X) FY Var(X) <=. (1) 


e ixl. 24 
Where A is the upper bound of Var (X;), for a 
The relation : lim var [(S,)/n] = lim (B,/n 2) = 0, as n > о ls from (1). Thus, the 


WLLN is applicable to this sequence. 


11*, Here T-5 487 +.+, so 
X 44%, + Х,) +. en UG X, „+ Х„)=пХ, +(n—-1)X, +...+2X,_,+X,. 
2 


Y в? «(n-2) o +. „+2252 +в? 3 o? (I +27 +...+п?) 


ч 


B, = Var(T,) - o? +(п1-1 


п(п+ 1) 2n 4 D o? / 6. 
quce (Bn?) —> o, i.e. (B,/n^) p casn 
WLLN to hold is not satisfied. Thus, 


p" н 
p аг. ' 


_» оо, it follows that the necessary condition 
WLLN does not hold for (S,). 
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For the sequence (а, S,,}, we have | 
a X, +a (X 4 Perey, +A, +...+ X.) 


Г, - a, S, + aS, + TT + а„$,„ | 
+ (а, + a) Arat a, Y 


= (а +a, +... +a) X, + (aj +а t) Ху +. 
} j 2 2 ) " 

B. = Var(T,) = (a, * ...*a,) с *(a, F. ta) С +..+(4,-;+4,) С +ас 
2 +24? 234.2 1 a ,)-4- 40а, * ...-050,) * ..* 2(n-l)a, La lg 

= (ба + Zo +... +A, ) + «а, а, ove 1 *^n ^e 4 nf 


` (B. / n°) = Са?) + Xa, а, +... +a a) +40, а +. ES 0, ) ssi 2(п— Da, — a, Ho АА): „ср 
Because na, — 0 (given hypothesis), hence by Cauchy Theorem on limits 


ыалы Nm 


Again na, > 0 — a, = s/n, so that a, > 0 as n > © ; whence 


ааа] = 0. [by Cauchy Limit Theorem] 
n 


Let 0, (a, +a, +..+@,) (a, 2а, * na, )/ n 
= [E(ia2) + Заа, + 4да, +... + (n 1) aya, +...+ Qn- Da, ,a,]/ n. 


As n > ox 0, — 0 (by two preceding limits), hence in (1), (B,/n^) Xo. o > 0 as n — c, 
Thus, WLLN holds for the sequence (a, S,} provided na, — 0. 


Chapter 12 : Bernoulli Binomial Distribution 


Sec. 12-12. Page 386 —— 


1*. Let the variates X and Y denote the number of boys and girls in the family ; then 


4 
à) РІХ21) = 1-Px=0=1-(4)(1) =l- =i. 
Gi) Р((Х>1)П(Ү>1)} = 1-P(X2 DNY =D} =1- P(x =0) U (Y 2 0) 
= 1-(P(X=0)+ PO 0) -1- (o. )-7. 


2*. Let G and B denote the birth of a girl and a boy, then P(G) = 1/2 = p = P(B). The 
number X of girls in the family with 5 children is bin (5, p). Hence 
P(X =k) (2) Жыз РСР А 
к) P "un-pra 
Let L; and L, denote the events : at least one child is a girl and at least one child is а boy: 
Then since X denotes the number of girls and 5 — X denotes the number of boys: 5° 
PIL, \Ly) = P(X2)1(6- X) 21 - PIX21IX <4}= Р{1<Х<4уР{Х<4} — 


P|1« X «4) =p, жр +ру+ ру XP I io i-i р Р(Х=0) „© 


k =0, 1, 2, 3, 4, 5. 
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o A E / 


=5)=1-(1/32)- 31/32 (3) 
P{L,\L,} 230/31 nm e 
у Es I "P : [by (1), (2) and (3)] 
* = target 1s >d in a si 
з”. р g etected in a single scan}, = 0.1. Now 


4 
TOA ONORE] 
= 522/10* = 0.0522. Pes vagi ин 
(b) РОВ) = 1 - P (zero detection} = 1 - 420 = 1 — (9/10)? = 1 – 0.121 = 0.879. 
4*. Here p = (6/10) (prob. of a good bulb), q = (4/10). Let L, = (At least one bulb is good) 
Now room shall have light if at least one bulb is good. Hence 
P{L,} = P(X2)-P(X-1) P(X =2)+ P(X =3) 


Gs) Gs) + BS) С) 

134107010 2410/4101 (33410 
= (288 + 432 + 216)/1000 = 936/1000 = 0.936. 

5*, Here p = P(A) = 3/5, q = P(B) = 2/5, п = 5. The Probability that A wins r games is 


ATE 


If L, = {A wins at least 3 games out of 5| X > 3}, then 


20 


5 fi - 5 $) 3 utr 2 3° ere ЗҮ, 
P(L,) = E X ES UNES лбе (40 3099) = 1.2557 3,55 7 048. 


6*. If p is the probability of success, q that of failure, then we are given that p: q = 2 : 1 
providing p = 2/3, q = 1/3. Hence, for a Bernoulli trial 


6 
P(X =x) = (Jer =(°) (+) (2. 
Let L, = {At least four successes} so P(L,) = P(X > 4) = P(X = 4) + Р(Х = 5) = Р(Х = 6). 
6 
1 6 6 6 _ 240+192+64 496 
ao (S [«(9):9(9): (9-09 = 


7*. The process can be split into two Bernoulli's uials ; 
First trial, P(head) = 1/2, n = 100, x = 50 


50 50 00! 100 
А 100 І 1 = l (5) = 
Р Р(Х = 50) = C30 5 50150102) "0096. 


Here p = 0.0796, п = 5, r= 2 


r= 


Second Trial. Event of throwing 50 heads. 


* ; 2 10 x 0.78 х 0.00634) = 0.049. 
P(R = 2) = (5 (0.9204)? (00796)? = 10 x 0.78 х ) 


The required probability P is obtained by 
P = 0.049 x 0.0796 = 0.039. 


hed 
. 


the principle of sequential counting 
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8*. We consider the sample space S where 5 = {Н > T, Н = T, H « 19, where Н > 7 
means more heads occur than tails and so on. By symmetry, P(H > T) = Р(Н < Т). 


Now P(S) = Р{(Н > T) 8 (Н = T) 8 (Н «DI = 122P(H » T) + P(H = T). 
P(H > Т) = (1/2) [1 - РІН = D) NO 


Thus 
Now P(H) = P(T) = 1/2, and to obtain equal number of heads and tails out of 2л flips. 
we require n heads, whence 
2 2n-n n 2n i е 
Р(Х = Т) = (7) (4) -(n QQ) 
E 2 2n 
P(H»T) = ii- C0) j [by (1) and (2)] 


9*. Probability of a head turning up on a single toss is 1, and that of k heads in n 


throws is 
P(X =k) 2s © pags: = С, (4)" (poi) 


t En Tn n||(* 1 
P(X <r) = E »x-o-[0-0)«- 00 | 
10*. Let p denote the probability of success and д = 1 — p. Then 
P(E,) = ре? проту Go p 


n-2-r 
р Е . . Ё 

с = B which is independent of n iff z^ Ё 

Тһиѕ р= 42 р= 9 = 112. 

11*. Let p = P{even face uppermost оп а die}. Then the probability of getting x even 

numbers in 10 throws is 


Ро) pi Sx ал аө. NY 


We are given that P(X.5 5) = ОРГ Чу 5 py pq- (2) p* dí 
This gives, (1/5) p = (I/3)g m: p = sil 
10 у 10= 5 
рй {'°) (0725 [by (1)] 


The required number f when 10,000 sets of 10 throws produce no even number is obv 
f = 10,000 P(0) = 10,000 (3/8)! = 1. 

12*. Let p denote the probability, that a given ball is in one of the first r boxes: 

р = (r/N). Treat the distribution of n balls as an n-fold repetition of the experiment ^ 

placing a ball into one of the N boxes. The experiment succeeds with prob. 4 = E v 

when ball does not fall in the first r boxes. The problem is now a Bernoulli's ^^ 


hence the required probability P is given by 


jously 


so thal 
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бэй, п n-k r fA - 
Р = (1а р =(„)(1-)' "(д)". 
13*. (a) A will beat B if A wins three 
corresponding probability p, is 


LE m 4-3 , \: 
a фа (3) (4) (4) =: (р=а=1) 
Again, А will beat B if A wins five 
probability р, is 


games out of four games played, and the 


games out of eight played, and the corresponding 


n= GG) OS 


Since p, > p>, A is more likely to win 3 games out of 4 than to win 5 games out of 8. 
(b) The probability of winning at least 3 games out of 4 is 


ру = (3)(4) «(Oy =4+ 4-8. 


The probability of winning at least 5 games out of 8 is 


[ву (8). (8). (8) (AY өз 
м, = GEG =з 
Since p, > ру, it is more probable to win at least 5 games out of 8. 


14*. Suppose X is the number of persons who make reservations on a flight and do 
not show up for the flight. Then X ~ bin (100, 0.05). Thus 


P{X <95} = 1-P(X>95)=1- У (799). ооз) (095^ 
x= 96 


15*. The probability that a thing is received by a man is p = a/(a + b). The probability 
that a thing is received by a women is 4 = bl(a + b). Hence the probability that (2r + 1) 
things are received by man is 


2r+1 ,m-2r-1 14 
Р(Х = 2r + 1) = E T9 q ops 1702037. i 


The chance that the number of things received by men is odd is 


p, = DP(X=2r+1),r=0,1,2,. 
ps (yat p+ etr em + ET 
From the two binomial expansions 
axpr = а (1) rer nm (2) 
Ee м} BURNT 0) дира ier 
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Ll. — й. AM cis aie лена 
Subtracting (3) from (3) and using (1) 


2P, = (4+ p) -(q =p)" =F =(4+){(b+ ау" - (b — a)" )/ (b + a)" , [putting for p and q] 


16*. Since n is very large even number, let л = 2k. where k itself is very large number 


. ` Av il 
Also p = prob. of a getting a head on a single toss = 5,47 5: 


The prob. f(x) of getting (k — x) heads and (k + x) tails is given by 


до = (29s e7 "(2207 - 


The prob. of getting k heads and k tails (put x = 0) is thus fO). 


k-x+1/2 k+x+1/2 

Ds G5 (| k+x+1/2 k-x+1/2 

LEM a hae ы РИИ a SS pez (1-2) [by Stirling Formula} 
qe" y k k 


Taking logarithms we obtain 


ш) B (ах) а) (e 3)w(1- 1) 


[ymo go e. ieee = (=) gd 
- (es Da zn. k х+2 22+.) П +0 т 


This gives : To) = FO). ° (since k — ©). 
_ (2k D EAA k+1/2 fok + 1/2 a MM 
E UNE CHG Em ix ux 


the above result reduces to f(x) = (2/ nn)? e QI as k=n/2. 


Sec. 12-21. Page 390 


1*. Since the number of black balls equals the number of white balls, p = P {a black 
ball drawn} = 1/2. Thus, p = q = 1/2. and n = 5. The frequency of x ball's being black 15 


5-х x 
L 5 (2) (5) =< DA. ar 
fix) sis(3)(3 ^P Er (>). [^ Lf = 819] 
This gives f(0) = 819/32 = 25.6. We now use Iteration formula : 


oth a nu ' i at. 
fix + 1) 27 qi le. fcd) TD, 
7 fU) = 5700) = 128, f(2) =2/01) «2256, f(3) = f(2) = 256, f(4) = 4, f) 128, /(5) = 1. /(40 - 256 
The following table compares the frequencies : 
Observed frequencies : 30 128^ 277: 294 136 27 
Expected frequencies : 25.6 128 256 256 128. 25.6. 


JG. 


Soluti 
— 7 Lons to Sta > ms 
E-- en. Ame = pi = roblems | i 751 
(a) If p, denotes the prob. that 
: dat rain falls on x d; ays of a week, then 
МЕГ " alla = А 
Р, k Ja px /(3)’, x=0,1,2,3,4,5,6,7. 
xt ioa 
Р» Эзу, /3' = 35 x 16/2187 = 560/2167 = 02561. 


п-хр . 
| +1)= ), [n= 


= +p, =0.1280 = 

ра = 2Р» » Ps = (3/10), p, = 0.0384, Ps = (1/6) p, = 0.0064, p, = (1/14) р, = 0.0005. 
P(L,) = Ps + P4 + Ps + р, + ру = 0.4294. 

We now attend to the 2nd part. Let W, mean ith day is wet, etc. Then 

P{W, W, И, W, Ds D; D] = P(W,) P(W,) P(W,) P(W,) PD.) P(D,) P(D,) = {P(W)}* (OD) 

= (1/3)* (2/3)? = 8/2187 = 0.0037. 
3*. If p is the probability of safe arrival, then we are given p = 9/10, g = 1/10, n = 150. 
Mean = np-13$5,6 = Jnpq = 413.5 = 3.674. 


Í — — Sec. 12-31. Page 392 —————— 


1*. (i) (n + 1)р = 4, hence k = 4 and k = 3 are two modal values. 

(ii) К + Dp] = [17/2] = 8, hencek = 8 is the modal value. 

2*. Let X be the total gain of the player A. The r.v. X assumes the values — 1, 0, 1, 7 
with the following chances : 


P(X =-1) = P{no вяз) (2) - 19, P(X =0) = P(I six] - t 58 -3ic 


P = 1) = P sixes] - (3) (4) (3) -d5.; pox =2)=P(asines|=(3) (3).(4) -4s. 


РА ЕТА. Кы. ДЕЛ 
EQ) = CD 5: * 316 * 216 ^ 216. 216 © 


Since E(X) « 0, the game is not fair. 
The game may become fair if A gets Rs с when t 


-125 12/1 oe -Rs 111 
Ва Е 216 +0+ 416 * 216 => c=Rs 111. 


2 
3*. Here u = np. Chebyshev's Inequality : Р! IX-plza}so/a. 
E p = P(IX-101«8)21- o^ /64 115/128 = 113/128. 


15/2 _ 
р = Р(Х - 10110) «5g = 007. 


Bp 
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(b) p = Р(1Х-201<5}=1-Р(1Х-201> 5}>1- 10/25 = 3/5. 
(c) p = P{IX-201>10k}<10/100k°=4 => k : 21 410. 
— Sec. 12-43. Page 397 ——— 


1*. Here np = 5, npq = 9. If we divide out, we get q = 9/5 > |. This being impossible, 
the statement is wrong. 


2*. If o? is the variance, then o? =npq=n(p- p) 


2 2 
а n(1— - 2p), © - — 2n « 0. ug 2-5 = p=1/2; hence q = 1/2. 
P dp? dp 
Thus max (o? ) = max (npq) = n/4. 
а", Р(Х > 1) = 1 Р(Х <1)=1- Р(Х = 0) =1- "C, q" 21-4" 


= 1-(1- р)" =1-(1-пр+...) =пр= p- 


4%. y = f(x) ("атр [x #0, n] 


x 


dy ые ) x= ү, ке 26 n-x-1.x (") X 2-51 2-2 
ар [хр (n — x)q р 1= x Pq p d =y n Р З 
d^y my E AMhomnosx 
dp? р 4 р? а? 


а?у E-xHcx ny 
бу 20 >> x=np or р=; =-—y|—+— |=-— <0. 
dp n ар? bond р? 4° pq 


Hence the estimate (x/n) is the maximum likelihood estimate (brief : MLE) of p because 
of the above maximizing property. 


[^ [sin (=*)| Ў È ы (=) (4) ga is ü ра? - B qp" 


4pq(q^ — p) = Apq(q - p (4 + p = 4p - p (1- 2р). 
6*. Here np = 6, пра = 2. Dividing the latter by former we get q = 1/5. > Р = 2/3 and 


п = 9. Thus 
«o = (GI GIG] не 


7*. We are given that : np = 4, npg (q – p) = 1.92. 
4q(2q -1) 21.22. = 24/-q-048-2(q-0.8(24 406) -0 > 47 0.8. 
Notice that q # —0.3 as д x 0. Incidently, p = 0.2 and n = 20. 
Var (X) = пра = 3.2 giving с = 432 = 1.789. 
u, = пра (1 + 3pq (n - 2)} = 32 [1 + 9.6 – 0.96] = (3.2) (9.64) = 30.848. 


Ш 
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EN oy — = vB, =03354, p, = + - EU - 30125; y, = В, –3= 00125. 
и (3.2)° ? 
OO ——— 
Sec. 12-63. Page 402 ——s 


1*. By additive property : (X, + X.) is bin (n, + n,, p) whenever X, is bin (n, p). Now 
PX 3/5) = РОХ врху) bin (5, 1/2) 
ERES DIY, 10 
P(Z = 3) = (3)(4) (3) = 35° [Z= X, +...+ X, ~ bin (5, 1/2)]. 
5 5 
(b) P(X> 3/5) = RZ»3-PZ- € Z=5))=p,+ = (3 (3) *(3)(2) “зз: 


(c) P(X <3/5) = P(Z < 3) =P{(Z=0) 8 (Z= D 9 (Z22) 2 po * P4 P2 


"Он в 


2*. For fixed value of P = p, say. G,(t) = (q+ рг)" 
Differention gives Gt) = пр (а + pr" 55 EX) ae (Den p. 
Now, we use Double-E Rule. 

E(x) = E,[E, (X? IP 2 p] = E,In" P] 2n? E(P') =n yy. 
3*, G(t: X) = гр+ а= 4 +Р! 
G(r: X, +X, +... +X,) = GG: X) Ge: X) -.С0:Х) 12 Ind (X, X] 


G(t:X) = (Gt PD = É («|4 (0 x= 0,1 


х=0 


п N-X x 
Thus Р(Х =x) Coeff. of г in G(t : X) = (tja p,.uUsrsu) 


Remark. This Example provides another derivation of Binomial Distribution. 


4*. Неге G(;X) = Ept” = pat? +P + q°)t' + pq = pq * (p +4°)1 раг. 


G(: УХ) = [G(t : X;)]" vs [ра * (p +4): = pac T [X, are 1.1.d.] Wir 
Since X ~ bin (n, p), Y ~ bin (n, 4) and Ind. (X, Y) we have 


Gu: X) (0-pt pt) , G(t: Y) 7 (1) 79 * 410)" 
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Git: X + Y) = би: X).G(t:Y)=(q+ pt) (p + qt) y = [pq * (G^ +q’ 271+ ра! i 
From (1) and (2), G(t : XX) = Gt : X + Y), hence the result. 
5+, P(X e x1 X> 0} = P(X = xJP(X > 0) = fÆ – Р(Х = 0)] = Л) - 4) 


Га). бет» 
1-4 | a 


à i X 
G(t: X) = E()- ae 2 1—4”) 
(1-4) Gt) = Y 1 f(x) — /(0)=(а+ pt)" —4" [Added : f(0) — f(0)] 
xs=0 
Thus G(t) = [(q pt)" -q"]/(1-q’). ED 
Differentiating (1), k times w.r.to ¢ yields 
(1-4") G^ (1) = пр“ + pty * = E[X]=G6 () «n? p* /(0)— 4") юл 


So Е(Х) = лр/(1—4"); EIX(X - D] 2 n(n - 1) p ( - q"). 


2 2 NE] 
varo -&ge)- Eoo - S8 - DP, e. [ je p-e : ) 
ag y Iq 1—4 1-4 4 


Sec. 12-80. Page 409 — MÀ 


1*. For the binomial frequency distribution, м(1+1),, we have 
1 1 п п T n n it n РА T n 
Ut : 5) v4(3)() 199 COMM | 
2 " ffnY (п n n n 
or N (5) (9*0) ^)» (9 "T. 


The other symmetrical distribution is identical with (1). Hence we superimpose the 
two distributions, as suggested, to obtain 


“ШЇ E 
ЖОЛОП ЕДЕ ШЕ 
sw Ch) = (7) Q2) «2 


-omparing (1) and (2) we see that the superimposed distribution is also symmetrical. 
with degree (n + 1). 
2%. Let A = (X 2 n1 X » 0), B,- (p = pj). 
‘Then by Multi-Stage p-Rule : P(A) = P(B,) P(A | Bj) + P(B,) P(A | B,) 


"ur 


EN o — o Solution to Sta rred Problems f 5 9 


E аво = PIX =n, p- pix » oj РО) Wi "i 


P( X > 0) ( | 4! ) | qi 


Similarly, Р(А1В„) = р; /(1- 4). Since Р(В |) = Ө, P(B,) = | — Ө, we readily obtain from ( 1) 


КА) vcn Mem. 
1-q, 1 – 45 


3*, Here, probability of success р 


0.25, а = 0.75. The sample size, or number of 
runs л is not known. 


(q di р)" - q" j- H ay" p+ fa q' p) "UN 
(0.75 + 0.25)" = (0.75) + n(0[75) ^! x (0.25) +... + [(q + р)" gives various probs.] ...( 1) 


These first two terms represent the prob. of 0 success and | success respectively. the 
remaining terms give respectively probabilities of 2, 3, 4, ..., successes. We want that 
these latter probabilities account for 80% of the possible outcomes, hence the sum of 
the first two terms in (1) must be no more than 0.20. Thus 


(0.75)" + n(0.75)"~ ' x (0.25) < 0.20, i.e. (0.75)"~' [(0.75) + n x (0.25)] < 0.20 
or (0.75) ! (3 + n) < 0.80. 
We solve this equation for n, by trial and error. Thus : 

n=5, LHS. = 2.5312 ; п = 10. LHS. = 0.9764 ; n = 11, L.H.S. = 0.7884. 


This shows that a minimum of 11 runs will give at least an 80% assurance of at least 
two successes. 


4*. Let X and Y denote the number of successes in the first half and in the second half 


of n events respectively. Then X - bin (i n, p) Y ~ bin (4 n, q). 


E(X) = np/2, Var(X) »npq/2; E(Y)-nq/2, Var(Y)=npgq/ 2. 
If Z denotes all the successes in л events, then Z = X + Y, so that 
EC E(X + Y) = Е(Х) *E(Y) = п(р+ 4) /2 = п/2. 


Var (2) = Var (X + Y) = Var (X) + Var (Y) = (npq/2) + (npq/2) = npq. 
Notice that X and Y are independent variates. 


5*. We shall utilize mathematical induction to establish the given result. Note also 
that д = const. during the course of differentiation w.r.t. p. Now 


ч лел ps or + ABT Xm 
r2 Gy - Ea pis 97. È (n)a pr 


х= 0 {= 0 


oT А t DLE d x= È ("архы 


ie») 
"S 
| 
м 
" 
© 
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This starts Induction. We assume that 


It follows that the given result is true for К = 1. 
the given result is true for I < k = т ; so that 


д a ‚ : ч n-x ox „т 
s^ ўеш Т һе А т - q P X , 
Ç 2) i >, X, 
‘p’ and multiply both sides with p, to obtain 


ml 


j Q д p ш n-x,.X M+ д "= d 
н] =" = (ea) rm 


It follows by mathematical induction that if the result is true for k 2 m, it is also true for 
k =m + 1. It is already shown to be true for k = 1, hence the result is true for any integer k 


Differentiate this w.r.t. 


Note. For k = 2, we have 


r д nes n- n-2 Í 
ра = Pay WE АЛ !'3 e np{(q+ py" '+(n-1) plq + p ) 2 np(1— pt np)- пра + (пр) 


and so on. Central moments and f,,f), can thus be calculated. 
6*. By Partition Theorem : P(X = x) = P(X = x, Y = 0) + P(X = х, Y = 1) hence 


END ION fe Y '[og-e)Y 
куз = | Ө+Ө” | (ку) “(eee | 0+0 | 


[0*(1—0)'7* 0'.- 0(0)'-* (1-0’)"]/ (0 + 0") 


00' -0(1—0 0 
Thus, P(X=1) = MT gig =P Gay); Р(Х =0)=0'/(0+0')=4. 


Thus, X ~ bin (1, p), where p = 0/(0 + Ө”). By symmetry, Y ~ bin (1, р). Wx, у) = Ду, x)] 
E(X) = E(Y) = p, Var (X) = Var (Y) = pq. 
lr from given p.m.f. E(XY) = P(X = 1, Y= 1) = @(1 – 0)/(0 + 0^). 


2 ' 
‚ = E(XY) EQN EQ) = 90-22 | (тз oe 15020) 
+ 0^) 


Var (X) = pq. =90'/(0+0')". p(XY) = (0y,/0, .G,) — (^ 0 — 0^). 
Chapter 13 : Poisson Distribution 
————— Sec. 13-12. Page 417 —— 
I*. Here P(X =r) = f(r) = e&^X Irl, r=0,1,2.. 
(a) fl) = fQ) > A^ NT e Xw2sE(X) 
Thus ҚА) = e?2*141-2e? /3=0.0902. [e° = 013534] 
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- i А 
(b) 20) + f(2) = 2r( = 2 


A LARIDE Me™ 


(с) A2 = 9f(4)-90f(6) — => (4) -9( / 24) + 902° /30 x 24), [cancel e^] 
M+ 3А -4-0-0?- p 


-2* 2 A=E(X)=2 


+4) > A=1(K £0). 


(d) Here fik) = e fk! k=0,1,2,... Now the required probability p is 
ppPX22xsay-fOsXs4 — rero — eG] __ 

PSA) ЛО) f eere) (A) 
2*. P(X 22) = 1-[P(X =0)+ (X - ] -1- e^ (1 А). 


Also Ёз” dx [x(e“*) - р =1-e"(1+A). 


Equating the two results, we obtain (1). 


ia _ Р(Х = х) f(x) 
* PIX= (004 C83 violino VPN д.7 M = hy 
3 PERIS } (X22) 1 (ХЕ: X22 3 4 


enim ae! m* 
e^ RUPES БЫЛ ETIN VARI: X uu. 
g(x) а" – (е -m B xe" = – m] 
4*. Recall decreasing factorial power : n® = n!/(n – k)!. Now 
P Dus exper S ais. IS CR 
Gt rh, MEAN CES S ndn 
Y 
Que SPERA, 
Yo P t! 
| -Kara AGSTE Y Т. 
5* Here wl ee _ = E n I 5 & =. 1 
; BIED 1 е *J 


ý 
Pri) Р(7+2) Р УЫ сро) ок 
Хе гъ 0) = Brice: P(r) “Рт +1) 7 P(r +К—1) 1 


If & < r+ 1, then summing over k, we get 


P(r) ista e M a 
КЕШЕ): s тро GE PCM г 


5 k) =1. 
Now, PO) _ jim P(X=rlX2r+ 
PLA ls Brem n 


r+ е А 
ИЙ. a P aay 
Meera” ots э” 1и | 
k) X 
+1) Р(т+2) РОЮ e pp( AJ osten 
PX = +) = P(r). o Prit Per-k-D r+] 
кол 


6*. Here 
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If A «rl, then summing over k, we get 
P(r) — i ч | i é А ^. 
E,P(X=r+k) ТШЩ Лл ХРИ) — r*l 
) 
Now, as r — ©, lim 5 — t eun = lim P{X=rlX2r+kj=! 


Remarks. If r is uit at and if we have enjoyed r trouble-free hours, then it is 
almost certain that there will be a breakdown during the next hour. 


7*. Here 5 = P(X2 ) e P(X 2k+1)+ P(X zk +2)... AER E A f(x) + Xf. | 


= /(К) +2/(К +1у+3/(К+2)+...= XI(k* r) - (k- NE eris. 
"АЭ iti gen Я AU ce. gyi 
Э reme (А+)! кл, (k+r-—1)! a БЕ E s t! 


= (I-A) P(X2k)- AP(X2k- 1). 
8*. Y = bin (x, p) and X ~ pois (A); hence using Double-E Rule we have 


G(t: Y) = E(t’) =E{E(t” IX =x)} =E{(q+ pt)*}=E(t,)*.[p.g.f. of Pois (A)] 


ем" = 1=е^ (+ р 1) L e - D 


Thus Y - Pois (Ap). 


Sec. 13-21. Page 421 


1*. Let the variate X denote the number of individuals suffering from a bad reaction. 
Assuming bad reactions to be rare, we treat X as Poisson rather than Bernoulli's variate. 
Now m = np = (2000) (0.001) = 2 ; hence 
P(X = 3) = e? 2? /3!= 4 х 01353352/3 = 0.180447. 
Р(Х> 2) = 1- P(X $2)=1-—[P(X 0) + P(X =1) + P(X =2)] 
= 1-e°[1+2+2]=1-5 x 0.1353352 = 1 – 0.6766764 = 0.3233235. 
2*. Here p = 0.01, n = 100, np = 1 = m. If X is the number of defective items in à 
sample of 100, then we need find P(X = 1). Here 
P(X 20) = e', P(X =1) =e" ; hence P(X < 1) = P(X 20) + P(X = 1) = 27 =2/ e. 
3*. Here n = 2000, p = 0.0005, hence m = np = 1. Let the г.у. X denote the number o! 
failures. So P(X > 1) = 1 – 60) = 1 – е! = 1 – 0.36788 = 0.63. 
4*. King's sample consists of л coins and the probability p of any coin being false + 


kin. The drawings being independent, Bernoulli's distribution is applicable. Hence, ! 
X denotes the No. of the false coins, then 


racer = (eo) E 


Soluti 
EE — . Sohttions to Starred Problems 7 о 9 
s very large, SS approxi i e | 
If 5 ! y targ 9ISSOn approximation holds : p(x kk 
5: XA=r)=e "k'[r!, 


n 


T inisters' MM 

(ii) РМ s’ peculations go undetected} = P(0 false TS (n)(1 3 
i iss i = (0 

Be ИУ targe, Poisson approximation : P(X = р) = |; lo bn Ў 

5*, Оп an average, there = inh (ise Rig) -e. 


is One misprint BEA 
misprints per page ; then р per page. Hence X = 1. Let X represent the 


=1--|1+1+= + 


END = рох еза А | l 1 
uou e 2 5 


r 


| (0.36788) (8/3) = 1— 0981016 = 0.02. 


М 
6 . Out of 100, the number of dead is 0.005, hence mean number of dead per 10,000 
is À = 0.5. If г.у. X denotes the number of claims, then 


PO= P(X»3)-1-P(X«3)-1-Ze"m'/xV (0<х<3). 
7*. For Poisson Distribution : P(X > 0) = 1 - P(X = 0) =1- e^. Since А = np, this gives 
on taking logarithm : np = –0п[1– Р(Х >0)).. 
In the problem quoted : p = 0.0002, P(X > 0) = 0.95 
леа 095). : м 
= (0000) ^ (Un, 20) x 5000 = (2.3026) (Un, 20) 5000 


(2.3026) (1.3010) (5000) = 14978.413 = 14979 cubic feet. 
8*. Let A = (no criminal is hanged}. Then by Multi-Stage Rule, 


P(A) = EPA =r} PO =) = (е^! /3) + (е 13 (614) + (0 112) 
r=) 


9*. Let X be the No. of cars crossing the intersection A between 6 P.M. and 7 P.M. by 
hypothesis, X ~ Pois (2). Now 
р = P({Ist car crosses Awi 
P(T < 1)=1-P(X=0)=! An^ 
Remark. We could use Exponential distribution as well. 
Sec. 13-40. Page 425 ———- 


thin 2 min.) = 1 — P(no car crosses A within 2min. } 


ы, 


l*, We twice differentiate w.r.t. “A” the identity e = Y(N/r!), 0<г< wo obtain. 


on X x V CX 
pe i ingt aja XR (CE). Jy |: k 0 
е => “>з ИГ E» : r! r=0 pt 


, 
К). r! f20 


Rh. ius c 
These give д. = E(X), А2 = E(X? - X); 8° Var (X) = EX - E 00 = А. 


Mean = variance = parameter À 
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——— Ü— sposi 


This is a remarkable property of a Poisson variate and is useful for discerning Poissonian 
or example see $13-60 (2) and example 13-33(b). 


nature of a vairate, f 
= 16. Now for a Poisson variate A = o^, the given 


2*. Here à = 5, o = 4, so that o? 

statement 16 = 5 is obviously wrong. 

3%*, Since X is Pois (100), E(X) = Var(X) = 100. Let Z= (X - wo, 
р = Р{75<Х <125} = Р(75 «100 + 102 < 125) = P(-2.5 < Z < 2.5) 


= Р{1271<2.5}> 1-— (100/25 х 25) = 21/25. 


Le. X= 100 + 104 


Thus p > 0.84 — lower bound for p is 0.84. 
Sec. 13-62. Page 432 ——M9— 


1*. We know that if X is Pois (A), then mean = À = c^. And if X is unimodal, the model 
measure of skewness $, is 
и-М А-А] 
ОЕТ T 
Since S, > 0, Poisson distribution is skewed to the right. 
Note. Recall : The asymmetry (skewness) coefficient of a Pois (A) is the quotient 


5, = р/с" = LG ie = 1/ JA > 0. Hence the conclusion : right-skewed follows as before. 


ЮА, »0) 


2*. The first four moments of the binomial distribution are 


н = лр, р, = пра, yu, = npq (q — p), щ = пра (1 + 3npq — 6pq) T 
The limit of Binomial distribution, called Poisson's, is obtained by letting p — 0, i.e. 
4 1, п — ©, but np = А (finite). Using the same letters for the moments of Poisson's 


distribution, we obtain 
Y 
Hs 
p, = lim (пр) lim q {1 + 3 lim (np) lim q — 6) (lim p) (lim q)} = A(3 + ЗАЛ — 60) =A + Ж. 


Л = пр,  g,-(np)q-lim (np) limg = А = А. 
lim (np) lim q (lim q — lim p) = M (1-0) = А 


Зе Let Y= X,4+X,4..+X, = nX. By Reproductive property, Y is Pois (nA). Hence 
P(X-k) = P(Y 2nk)-e "(An)" / (nk),  nk20,1,2,... 
Thus P(X-k) = e" (An)" ИЙ | kz0,1/n 2/n,...o 
4*. Since X, and X, are independent, we have M(t: X * X) 2M (г: X) . MC : Х,) mU 
As X, and X, + X, are Poisson variates, we get from (1) 
„бею sp = eM CDL MIS) <> M(t: X) elt 7”. 


The correspondence between m.g.f.s and the distribution functions now reveal that X; 
is Poisson (p). 


5*. Му 


Ele”) a E, (E(e* | N)) i [eX =” n] [Double-E Rule] 
E(e’”) = M,(t')= My(e’ – 1) = М(е - Y: № 


E —— $$ Solutions to Starre od Proble "ms 799 
6*. Suppose f(x) is the density of X | P 
: n. Then the density — of r.v. 3X IS y given by 


g(x) = }. fa) P(N =n) = B ro 0 o" 
n= Po р [Multi-Stage p-Rule] 


AUD = M(t: X x 
(1) (t (tet X) = М). Ms)... M(t) IM; = “та | Ni 


Obviously : M(t: X I n) = Xe" f. (x), and M(t: X) = Xe" g(x) 


A K t e? n 
Now My(t) = E(e )-E, (Е (е N)} = Е, {Ау (@)}= AO beer : А (t) „„(2) 


If X; are i.i.d variates, then A(t) = [M(t)"], and we get 


-0nn 


V 0 
M(t) = 2 Е | 


[M(D' = e* E = exp (OLM) - 1]) 
7*. Let e" = T(temporarily), then given m.g.f. is 


„А колны айд? 


М(::Х)=е d» SET te ET —— —e"z = Efe". (say) Wy 
By Dirichlets’ form of m.g.f. it follows that 
VÀ 5x 
fx) = t. x x0/5244 deer. X-Püus (01 


8*. Recalling the m.g.f. of a Pois (A), we at once see that X is Pois (4). Now for a Pois 
Wis с? = 4, hence 


p= Plu -20 < X <pt20}=P{0< X <8}= Р(1< X x7) ГО) 2 e*4* 1х1] 


Efo- 27% = 0.949 — 0.018 = 0931. 


i 
t4 
= 

" i M~ 


oe) aided | 
9*. Му) = (4+ pe) E14 pte bI ACE 


Where we used np = A (fixed). Now by Euler's Limit 


bnc 
(e ind 1) e = " 1 ( а) m ab 
lim Муй) = lim ||: „MeD [im D d 


deaths due to road accidents and due to other 


10*. mber of 
МЕ Rand V denote the nu is (2) and Y is Pois (6). By additive property 


Causes. Then we are given that X is Poi 
Z5 X + Y is Pois (8). Now 

10 98g? 

P(Z<10)= Lu 

À = 8 which is a positive integer. Hence the maximum probable number of deaths 


) is 7 or 8. 
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11%. Let X, ~ rm "m than $,m X, * «3 X, is Pois (A) where Аал + bd, 
[by reproductive property]. Жо 
= Р(Х, =rlS, = п) = P(X, =r, S, n)/ P(S, =n) = P(X, sr, X +... 1 X,mn-r)/P(S, =n) 
ME dud | еМ уг и AN ЕЭК M) ТСР р) 
mo (n — r)! n! rJX A À 
where p= À,/À. 
Sec. 13-70. Page 436 ———— 
1*. If X = n (fixed), then S ~ bin (n, p). Now 
ty) = E(e'*5P) SE (e 08е 2 E, E (e" e 1X =n} [by Double-E Rule] 
= E, (e^  E(e" IX = n)) =E (e^* (q+ pe bye 
= E (qe^ + ре")! j - E(0*) [p.g.f. of Pois (4)] 


= е*®@- = exp {А(4е° + pe") -A(p*q)) . 


= exp {A р(е" – 1)}.ехр {Aq (е) 
Thus, S Pois (Ap) and D ~ Pois (Aq) are independent distributed. 
Remark. The result is false if X is replaced by a fixed number k. 
2*. Recall that, if X ~ Pois (A), then first four moments are 


E(X) = A=Var(X)=),(X), (Х) = А + 37. jut) 


Now, Taylor's expansion about the point À, for the differentiable function Ф is 

ф(х) = 90) (x -2) 90) +- AY 121] 9" 0) + [(х А) /31] 9" () + [Gc 2)* / 4*] 9" " 0) + 
Let (A) = At, then ф'(А) = KA ', o" (A) =k M77, (AY = AP EE... (2) 
It follows that Taylor’s expansion of the function (X)=X* about A is 

Хк = X 4 (KD OA) X - X)! 121] 9" 0) - (X А)? ГЗФ" (А) € X — 3)" 41] 9" A) +... (3) 
Taking expected values of both sides and using (1) and (2) we get 


kK? 181 " ke M7? у (А Rania к 
2 6 24 


NG 4-0 
ME xd 


E(x") = А + +... [E(X - н) 80]. 


2 ‹ 


ki, Kk 7 D(k 2) (3-5) x- 
X 24 X 


k(k = 1) (К - 2)(k - M 
24 


We replace k by 2k, 3k, ... to get higher moments of (X А Thus 


E(X”) = EQ3) e 22% + kg - xt! КОК DO DEED зно. «6 
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pi - m Em 

) and is given by (4). Note that 
E^Y) Ра X dh ke ) 2 2k 1 


The mean value of Y is 


+k? (k = 1)? 924-1 a, LKB 


Е КЪА 1) 0" cago руза Амане. 
The variance of У is obtained from (Y) = 


EU у 
Ree WAR WA ek 1) Qk.— 1 (64 -5) 924-2 4.,.0 
(КОК 0) X7! e 1 kk – 1) (Bk? — 7k 5) А +...) 
" yk Hee D orsus }- dem d ...(6) 
Putting k — 1/2 in (4) and (6), we obtain 
Е(УХ) = VA {1-(1/82)-(7/12822) +...) 


Wan Xya= (n 44/322) 4... 


: 3 
Note. The evaluations of Е(У), E(Y’), ... are, though straight forward, but time consuming. 


3*. Zero truncated Poisson Distributed. Since X is Pois (flo eM Ix x92... 


fu е^ Г x! 


EMEND вору 59 [5^ PE 20h А POR = 00] 


x0 


v xf) m 
^ El(XIX»0) = D PX 0) "(лоо = 
As Р(Х> 0, Ү> 0) = P(X>0).P(Y>0)=(l-e "T а (ѕау) 
p= P(X*Y =nl|X>0,Y >0}= КР{Х+Ү =n, Х>0,У>0}= KEP(X =r,Y=n-r} 
KS P(X =r). PY 2n-r) [^ Indep. (X, Y)] 


n=l g7? А” e? Mcr A e? an [nal ü 
K r! ^| (n-r)! ze n! > r 
iw A е) п п -(3 _ Ке a i n 
а! b 8 0) (| m! KR 
n-1 
расу) 
п! H4 


* 
4*, Let P(X = k) = p, then 


Е) = pot pit tent pul Pal eR Pot Pit tt pat" 


r {Po p ? pit YN Pa} 2 t (Po р *ec Pa), [for r* a 1] 
i" P(X < a). [This settles (1)] 
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icu SOPORE ee eee 


When X is Pois (A), then С(ї) = E(r*)=exp [A(t ~ D]. (2) 


From (1) and (2) we get 
P{X < M2} st 
„ a [050,40 usns s À In t + A(t — 1). 


9 = 
042) Ait И, 0<1<1 res A 3) 


Let 
Differentiating we get (u' = du/dt) 


и = X -iAC, и" iA, ug 20 => t21/2andu"»0att-1/2 


Hence тіп In z = min и = 7 11(2/е) > z= (21 ey" 


Since (3) is true V t є [0, 1], it must be true at t = 1/2. Hence Р(Х < A/2) € (2e) 
5*. Note that P(Z = 1) = P(Z 2 1) - P(Z > 2). (1) 
Now, RKO = P(X=k=e'/k!, к= 0,1, 2,... 

P(Z>k) = P(X>Kk,Y>kK)=P(X=K). PY > k) = [P(X > Ю)]. 

Р(2> 1) = [P(X2)P -(1- /(0P - 1-67. 

КОЕ = IPX 22] et ^70) - FY 20-6" - ey. 
Substituting from above in (1) we get 


P(Z=1) = (1-2e! «e?)- (02 4e! + 4e?) Qe - 3! €. 


6*. G(s, f) = е7!) = X-Pois(a); so E(X) Za- Var (X). 
GS 4) =e") m LY = Pois (b); So E(Y) = b= Var (Y). 

Let W = a(s - 1) b(t 1) + c(s — 1) (t — 1); then G(s, t) exp W. 

(0G / д5) = [a+ c(t – D] exp (W); (O^G / Ot ðs) = [c + [a + c(t - D] [b + c(s – D)]] exp (W). 

Put s = t = 1, to get (0°С(1, 1) / д5 д) -E(X,Y) c + ab 


Cov (X, Y) = E(XY)-E(X)E(Y)=c, p(X Y)=c/ Jab 


Note. If a =b = с = 1, then G(s, ) = e" -1=G(t,s), so X and Y have same p.m.f. as under 


G(s, t) = a 2 (st) = P(X =r,Y=r)=e'/r!}, r=0,1,2,--: 


Chapter 14 : Geometric Distribution. Negative Binomial Distribution 
Sec. 14-23. Page 442 —— 


1%, Here T, ~ geom (р), ј = 1, 2,5 and by independence 
f(x,y) = ЛО). AO) - quai (mai 18x yo 
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= У T T - 
РР =ni p) ў Far 


r=] ye r+ 


= PP, У а! pa 
| 1 


© ; 1 
r= E ET 2.091195) EI 
2 r=] 


qw | 
By symmetry, P{T, > T,}= Р 4 /(1- 419). 


Note. P(T, > T,}+ P{T, >T,} + P(r, =h) = 1, 


; FU, -T) = 1 (0р, + ра) 1-44) = p p; d 4 42- 
2*. Let X and Y be the number of shots fired by A and by B respectively. Since X and 
ү are independent geometric variates 


х=] yn 
Pow») = Ро) Ро) =(2) $(2] 3:&»-123.5 
If p is the required probability, then 


" T" " 2 es] 3 (2 y-1 5 
Р(Ү > Ху= Pe = (2) 3 (2) = 
p ) D (x, y » x) m > 5 5 7 7 


x2sl-ysex-l 
E.g (2) -3 2 
Ер: 


ме (5) i-i T0) 


xx 


3*. Each of the 100 sampled items has probability 0.03 of being defective. The number 
of defectives in the sample, X, is consequently a binomial variate, and we approximate 
it by Poisson law. Since A = np = 100 x 0.03 = 3, we have, 

p=P(X=3)=1-P(Xs 2) = 1— 0.6763 = 0.3237, (using tables). 


Each of the samples has thus a probability 0.324 of stopping the machine. The number 
of samples taken between the successive stoppages is, consequently, a geometric variate 
With mean 1/р = (1/0.324) = 3.1. Thus the average time interval between Successive 


adjustments is 3.1 hrs. 
4*. Here fo) = 0/2) = pat |, (p=q=1/2), 1&x&o. 
E(X) »1/ p=2; o? = Var (X) 4! р -2. [X ~ gem (p)] 


a 3 -4t=1 
Chebyshey’s inequality : Pu X -ulsc)»1-G' /‹ ) SAPUN 3282)» 1544. 


Actual probability p, is given by 
p,- PüX-2is2)- РІ0 < 
Note that x = 0 is not defined by given р. 
2 fA. 
p,» (+) +04) +0) 715/16. 


2 


Х<4}= EP(X- К), k=1,2,3,4. 
df. so f(x) = 0 at x = 0. Now 


AE 
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5%, Noon vient as ata ge. Yy<m => {(Х<т)[\(Ү < m)). Thus using indep. & с d.f 
P[max (X, Y < 1] = P(X <m). Р(Ү <m)=(1-q").(l-q")=(1-q"). 


P{Z =m} =P{Z < m}- Р{2<т- 1] =(1- 24" + q?") -(1- 24" +q?) 
= 25" ! (1 E q) A err 2 (1 А. q^) S 2 pq" nm p(l + q) p^" 2 L^ q= | p]. 
Sec. 14-51. Page 446 —— — 


1*. Recall that for geom (p), M(t) = p(1 – ge’). Comparing with the given m.g.f. = (1/5) 
[1 — (4/5) eT ' we see that X is geom (1/5). Hence P(X = x) = d' p, x = 0, 1, 2, ... 

Р{Х = 5 ог 6}= Р(Х = 5) +Р(Х = 6) = pq’ + рд = pg’ (1+4) =9 х LD 
Note. If m.g.f. is e'(5 — 4е'у`', then Х ~ geom (1/5). 


2*. Let X and Y be the number of throws required by A and B (separately) to obtain their 
objectives; then X is geom (p,) and Y is geom (p,), where p, = 1/6, p, = 2/6 = 1/3. Hence 


fos4q np (у) = 9! р,; х у=1,2,... 
k k 
p= P(Z=kh=P(X+Y=hH=> PY =j,X=k-jy= У PY =f) P(X-k- j) 
j=! jz! 
ub. 4 


| ih T l 
= È ' р) (та )= рр E («ay | Э 
j j= i va 


sarye CREE eco 
186 1 (4/5): | 1806 943 | 


Method of generating functions. G,(t) = рү (1 — чү), Сүй) = Ed 2X у 
Сд) = Gy(r) . Су) = p, py FI — 440 (1 — 4, 0) = 718 (1 — 21/3) (1 - 51/6) 
icm cam-si)-i£( 
Тоа dog Lii Ni 
P(Z =k) = coeff. of i" in (1) = (5/18) (5/6) -? — (2/9) (213y 2. 


3*. Note that P(X <x)= pr MIS Иде. 


(a P{Z<x}= Р(тах (Х,У) <2}= PIX «z Y «z)- PX «2 P(Y «2 - (01 47y. 
P{Z=n}= P(Zxn)- PZxn-1))-(01-q"*y -(1- "y = pa^ (2- q" - 4") (0 
(b) To find P(Z =n, X =k}, note that if n < k, then {Z = n) N (X =k} = Ø so P(n, k) = 0. 
Thus, we need to consider only n = k or n » К. 
For п = k, we have, writing P(X = a, Y = b) = P(a, b) 
P(X2k,Z-k) = РАХ = к, тах (Х,У) - k)  P((k,0) DK 1) Ы... В (k 0) 
= P(k,0)+ P(k,1)+...+ P(k, А) 


É k 
= P(X=k) X, PW = j) - (pq^) У рд = pq‘ (1-q"*') [X & Y are Indep.] 
j=0 j=0 
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For n > k, we have 


fk, п) = P{X=k,Z=n)=P(y 2n. X = к) = P(Y =n) P(X =k) (pq ) (ра ) = p'q"*' 


0, n<k 
MXek, Zen) = pq’ (1 - q***), nk 0,12... (2) 
к”, ИРКЕ 0.1.2... (2) 
Observe that У Р(Х =k, 7 = п) = УДК, n) = 1 ; as У fk, п) is 
ы q'* Í A. TES = i ^ == 7 =: 
2 P pq (1-q4**')- È | Xp q' |- Y, рд (1- q**)- У (рд!) = È ра* =1. 
= k=0 | n=k+| &=0 k=0 k=0 
1 >. k+l / ; = k+l _ k 
f(k, n) | z i УТ, 4 П: 2 A i s 
—q', if п> к. (mse n = k in (2) & (1)] 


(c) P(X 2klZz2n)z 


(d) 


k 
mre. Pa 102-9 
P(Z =n) О. 1# n<k 
pq (1—q**')/ pa = Lagt" (n=k) 


Р(2=піХ= к) = ete Ba 1 pq‘ = рд", М (п> k 20,1,2,....) 
^ О, if (n«k) 


4*. We define random variables Ху, X», ..., X, as follows : 
X, = No. of balls that must be distributed for any one cell (say the first cell) be occupied. 


[Obviously X, = | because the first ball automatically occupies one cell.] 


X 
X, 


additional No. of balls that must be distributed to occupy any two cells. 
additional No. of balls that must be distributed to occupy any three cells, etc. 


Once one cell is occupied, as successive balls are distributed, failures occur when 


these balls enter the already occupied cell. A success occurs when one of the available 


N – 1 unoccupied cells is finally entered. The Prob. of success is р, = 
X, is geom (p,) where p, = (N - 


(N — 1y/N. Thus 


1)/N ; X, is geom (p) where p, = (№ – 2)/N, ... and finally 


X is geom (p,) where 
P, = [N - (k - DIN, etc. We observe that X, are indep. geometric variates; hence if 


X= X, * X, + .... Жу then 


G(t: X) = G(t: X). G(t: X,) ... G(t: Xy). 


Substitute the values of G(r : X) е 


pt prt Pyt жр, 
E esses So HR A . "n P 20 ) 
G(t : X) 1-qi 1-97 1- qut q P; р 


v(N-1 1 N-2 1 1 уату) 
(м тем) м 1207) AN 1-00-02 


N 
= N!0"(1—0)" (1-20) ..[1- (№ - DO]! .[r/ N - 0] 
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Sec. 14-72. Page 454 ——————XÀ 


768 


—.————————— 
1*. The number of trials X on which kth success occurs has the Neg-bin density 


| i 
f(x) = Ё IL q k xak, k+l,.. 


1/229g,x = 10, К = 5. 


Неге р = 


у) 0) ~) -@ 
- (4 ОИ МТА ;(2* 
2%, To get 2 defectives, we have to perform at least two trials (drawing one item at а 
time). The probability of a success is 0.03 for every trial. The situation admits negative 


binomial model; hence the required probability is 


ud I ? 4 T. 
p= {X25)= X Penna ante 2, (1) ооз) (0.97)? 
x25 x22 


= 1 — 0.0009 (2 + 2.91 + 3.7636) = 1 — 0.0009 x 8.6736 = 0.9922. 


Comments. Neg-bin as difference of two sums of Binomial Probabilities 
If X is the number of failures preceding the kth success, [X ~ NB (k, p)] then 


px) koe ate. Е, du (1) 


“У 
| 


P(X > x) = P{more than {x + k) trials are required to obtain k successes} 


К S (xk Í mkk-] 
= P{(x =k) trials produced fewer than k successes} = 2 j 


J= 
din hd "a у 
p(x) = Р{Х>»х-1}-Р(Х>х}= У, үл» Jp TES Gale m— 
j=0 J j=0 j 
Sec. 14-94. Page 459 BE 


1*. We know that и = E(X) = kq/p, and so, by definition 
e k+x-1 xot 4 Kq Г 
hom 2, | М Ja p (- з NU 


x=0 
We assume that the infinite series (1) is uniformly convergent, so that term by term differentiation 


is legitimate. We differentiate (1) w.r.t. “4° and noting that (др/ да) = —1, we obtain 


On, . $ k*r-1|8] (x Не a 
Oq | x jal pfa 3l 


Фо | aa | k r k r-1 
| Jatt tat (1-4) -reg'p (n | р? | 


р 


x 
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о + х ) S arro > 
" zl x TP | (£-5)e- p)” “а-ну | 


ы 1 


Lo 


1 pd. kr 
= —E(X -p)*! Ех у-н rk 
q » Eu tact I 


A А a = д 
s Бу transfer : Н,,,=4 e + 2 zl 


B) definition of Survival function P{X > m) = G (say), we get 


С = РКУ т} = Y (letter 4 = k CT m 


9 


r=m 


ries is uniformly convergent, its sum being less than unity. Term by term 
tion leads to 


E- P) PU 1g-€*n _ (kir) p'Q e| 


E & | k*r-l КҮ er). kr) prg-&sreb 
ar rN prion [а т) рое 


E (0 — (r+ 1)}= фт), as ф() = б] 400 = Жө: а 


ч 2 | | р"- 1 ev n 
К+ т Шиве Lo кати Dan 2 eu аз. E 
4 nas Bom, k) 


LI E: r 

this result w.r.t. “P” in the range (0, a) we get 

Е: 1 т-р xy **? dx eae 
dele өйы! 0*9 бте 


y. P, = to original notation we get 


deja ^ Iw dina М 
X2m) evt 77 qe 


. p AR n iln 2. А ety" Tees а-а 


€ т Bim, (0) (РО) "77 rik) Tim) 
m мем ДИ 


“үт L o Hence) - me $ 0-11 ()] 
Е ' n 
5. m E Ne «t мрави $ ere X) 


x20 
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k 


y \k x [x] , 
/T(k*x)( a t _k «x«o, f(0)= te 3 = (p). | 
MEE = T(K) x! E (=) E РЧР" 4 art SON) 


Now Ўл = = kes Y f(x)=1-fO) > p fÆ- (0 - 1-3. X, A=- 70) ? 


xzl 


The zero-truncated density is thus 


fo = Акра" 1 х!, 1€x«o, [xl2x? s) 
© [х] o0 х pls] £o 
V са ks 
iit e xy > В 2 б<], Ра Il 


х=1 


q E 


. [y x- s] 


"e b] ws | | 
ра) каз) У SOP. purger). Go s- Doe] 
e y! 


A pig READ ite oS D a ОЕ [By CD] 
A(q/ р)" k(k4-1)...(k*s—1) = A(t/ay .Kk(k-1)...(k* s— D. 
. E(X) = ЛЕ / a), E[X(X — D] = À K(k +102, E[X(X — D (X — 2)] = Ak (k + 1) (k + 2)0" 

E(X?) = AkO [+ (Kk - 0], | Var(X) 2A K0((K - 10 1—2. КӨ}. 

E(X?) = Ak(k + 1) (k + 20? + 3AK0 {1+ (k + 1)0] – 2A КӨ. 

A= ph /p=14+(k+10;Bapy/ pl 1 3(k 1)0- (k+ D) (k - 2)0 
=(k+1)0, (B-1) - XA- 1) = (A - 1) (К+ 2)0. 

Dividing : m tum d 
4*. Let P (n) represent the probability that the nth trial (Т,) is the rth success (5,) : Now 


observe the obvious : 
(i) T, is a success and there remain (n — 1) trials to reach further (r — 1) successes ; 


(ii) T, is a failure and all r successes must occur in (n — 1) trials. 
Events (i) and (ii) are disjoint, so by Rule of Total probability. 


[gis = t/a = 9] 


which yields k and hence Ө = t/a is expressible in terms of 1/. 


P(n) = pP,-,(n-D*qEn-13,-2&rsn 
Multiply by г and add up to obtain 
|$ Вр РР (н-на Le а) => G(t)= ptG, (t) + qt G,(D. 
G,(t) = [pt/ 0 — qt)]G,_,(t)=[pt/(1- qn) G, (0) =... [pt/ 0-401 GO 
by repeated reduction of r. Now 
G,(t) = E) = Zt (pq!) = pt(Ve qt +g t +...)=pt/(- qt). 
Thus G,() = [pt (1 40. 


ч 
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Chapter 15 : More Discrete Distributions 
——— Sec. 15.17. Page 463 
ff. Since X is U(O, 1, ..., N}, etc P(X = r} = INN 4 1) = Р{У= ғ}, 0<r<N. 
@ Р{Х>Ү} = xP(Y =r, X >r}=} PY =r) P(X >r), [indep. (X, Y)] 
Sud AT 
| - | Bay 
(М +1) EPan- ew! Np 


iue E(X) = EP(X > р), if ris an integer [vide Chap. 5]. 
\ M ii Fiz 2 z} 


Miar >n- ip? PY > з) - [P(X 2 д]! =[1- P(X < 2f. 
x TE зг) =. 


г=0 


P(X < z) 


1+1+...4 1). "e ©... 
l FUE N +1 


a. z) 


9 2 
Еа - Piz> 74 E a 
Ere] í =r \ N+1 


[XN – 2) + /(N « 1, z-0,12,.., №. 


E OPEM all the n + 1 random observations together. One of them has to be the 
m. Each has the same chance of being the smallest. Hence, the probability that 
bservation is the smallest is p = 1/(п + 1). 
EJ E - 
; ШЫ; Е Ѕес. 15-27. Раве 472 


X denotes the number of defective items, then the p.d.f. is 


70) = wn еы: 10,02: M] 
эш «ees $ (DT) e) 


ic function of Hyp-geom distribution is not convenient as a means 


тоте әй of this distribution. 
Jom variable denoting the number of judges favouring A. Then 


reni (2 nnn 


i E T. = 3) 9 (X = 2), hence 


a x-a raa (6) 00)/9- з "58 
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3*, We shall make appropriate changes in the formula of p.m.f. 


fN, M,N) = (MN tel Ai) i(?)- [n д) 


(1) x>n-x M>N- M provides 


N-M)(N-(N-M) (N)- а"). 
n—x n — (n — x) nT In g x n 
Thus fin — х, №, N- M, n) = f(x ; n, М, M). 
(ii) хә М- х, п ә N - m provides 


о-во) А) à = v) 


By (4b), the R.H.S. is simply f(x ; n, N, M); whence (2) is established. 
(i) хә М№-п- М+х, no N-n,M—N-M provides 


N-M N -(N- M) | М | М-М Ji M i N | 
N-M-(n-x)AN(N-n)-(N-n-M-«xJ/ AN -n) = (М-М (п-– х) M- x) N-n) 


By (4b), the К.Н.5. is simply f (х; п, №, М), noenee (3) is established. 
4*. Using Partition Theorem : 


= P(X «Y =r) 


Pee ee P=) PY -r-klX-X) 
k=0 


ү 150 50—k)( 140+k 

> k )\10-К r-k )\l0O-r+k 

k=0 200 | 190 i 

10 10 

We expand the binomial E to simplify this expression, cancel terms and 
obtain after adjusting 


150!(10!)? 50! m ux $ 1 po 
Р, 200!1 (50—/)!(130+/)!_ Nm BC Emil (nox 


A" t(8:)-69) (ryan 


s а Рад 150 ) /(200 
S J 20 ) : p.m.f. of H-G (200, 50 ; 20). 


-— 
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Sec. 15-36. Page 479 


all faces alike}= 6/6°=1/36- | 
D pio }= 6/6 =1/36=p, [use Bin - distribution] 


Р two faces alike} = _3!_ 6x5 LUN 
| 2!1 W uu mor. 
ribution of X and Y is trinomial with n = 10, p, = 1/36 and p, = 15/36, 


ee 

li 10! e ) 15 1 15 10-х- у 

© xtydo- x — у)!\ 36 e 3i (1-52-25) ;0<х+у<10. 

E (n — 1) p, Py [$ 15-35] we get for the problem under consideration 
— EQAXY) = 24 . 10 . 9 . (1/36) (15/36) = 25. 

z à M(t: Z) (е“ )  E(g" "X -* e" E(e^* +) where t, = —t =t. 

" E ov e" 2[p*q*(0- p-q)e'y.[$ 15-53, p, = p. p; = 4] 


E 
)enü-p-9); E(Z:) = M"(0) - n(1 — pq) (n=) (17 p-4)* V 


Besos ou г)... 


-Y)=-Cov(¥, X) - Var (X)= пра - ng - 4 = - nq(1 - p - 9). 
| Nase Xu 


Sae Prsi = l- Èn=1- (E) 


1 


Б" 


Ре, 
Е 


ЫЯ 


ре written as 
) г 1 { 4 Үү > 
J s» > 
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с Op «+ бї pd) PiP = РР, | 
054 Oy e Or, | — (ny —p;Pn pd e PrP, | 
det [o] = ` ра wap tee T - ч 1 
си ба би =р ру PeP = Pa| 


J 


S, = py(-p +q = P; =- Py) = pl - Ўр;1= p; (1-1)=0 
S, = рь( Pi 7 P3 7 Pr- +96) = Pill = Xp]- p, (01 - D = 0. 
Thus adding col 2, col. 3, ... col. k to col. 1 and using 5, = 0 (j = 1, 2, ..., k) we get 


—P\P3 o PPk 
=р›рз oo Py 


k 
[с] = det [o;;] = Л а 
PPa Pedy ~ Ри; 


The value of this determinant = 0, as col 1 consists of zeros. Hence rank lo, l#k. 
However, the det. of order (k — 1) x (k — 1) occurring on the right of col. 1 and below 


row l is non-zero. It follows that rank 1С;1= А – 1. 


5*. For the Die Events; P(A) = 4/6 and P(B) = 2/6. By Multi-Stage Rule 
P(X = К) = P(A) P(X = КІА) + P(B) Р(Х = КІВ) => Р, = 5 P(X1A) - 1 Р(Х1В) 


Mie 2 (о ч " (0.5)? (0.3)? (0.2)? + (70) ko Faery . [trinomial and biv H-G] 


p, = 2 (12) (ОЗО А TEL E BL PY 2) Р(х =2)=1- p, - p. 


We have used trinomial and bivariate H-G to obtain ру, binomial [P(X | A) = 0] to get р». 
Now : E(X) = IP(X = 1) + 2P(X = 2) + 3P(X = 3) 2 3- 2p, - р, 


= 3212.301 (ogsye , 1(50)(30)(20) /(100]] 2 зо , as 
- Каке, 0.03) 3010) (19)19)/ (36 )|- 5-2; 6» 07". 


Chapter 16 : Normal (Gaussian) Distribution 


—— Sec. 16-24. Page 489 ——— 


1*. We normalize the variates X and Y. Thus (X ~ 30)/5 = Z, і.е. X = 30 + 54 
(У ~ 15)/10 = Z, ie. Y 215 + 10Z. Thus if Z is N(0, 1), then 

P{26 < X < 40} = P(26 < 30 + 5Z < 40) = P{-0.8 < Z < 2} 

PITS 535) = P(7 < 154102 < 35) = P(-0.8 < Z s 2] 


T 
(1) 


| " Solutions to Starred Problems @ 7 о 
From (i) and (ii) the result follows DC RR NN n 


, we substitute N Bl varius è : 
2. Here ormal variate for a binomial variate X ~ bin (2000, 1/2). 


— = 1000, с? = = ; / 
н пр прад = 500 : let Z = i. п)/с i.e. X = u + oZ = 1000 + 4500 Z; then 
py = P900 < X <1100}= P(900 < 1000 + /506 Z « 1100) 


= P(-2V5 «Z «2«245) - F5) - F(-2/5) -2FQ48) 1, [Draw a Picture] 


2 - 
Note. The use of М№р, 6^) for bin (n, p) for large n(» 30) is justified by CLT. [or 
limiting distributions]. See Chapter 17. 


3*. We use normalized r.v. Z = (X — p)/o = (X – 30)/5 i.e. X 230 + 52. [Draw Fig.] 
p = P(26 < X < 40) = P(26 < 30 + 57 < 40) = P(-08<Z <2) 
= (2) + (0.8) = 0.4772 + 0.2881 = 0.7653, [Ву N(O, 1) tables] 
p, = P(X 3015) = P(IZ|>1) = 2P(Z > 1) = 2(0.5 – 0.3413) = 03174 
p, = Р(Х 2 42) = Р(30 + 5Z > 42) = P(Z 2 2.4) = 0.5000 — 0.4918 = 0.0082 
p = P(X <28)=P{Z<-—04}=05-0.1554=0.3446. ^ (Positive Reflection) 
4*. Let Z = (X - p)/o, i.e. X = p + ©, ; Z ~ №0, 1). Draw a normal curve depiciting 
regions A, B, ..., F. 
P(A) = P(X > p + 0) = P(Z > 1) 20.500 — y(1) 20.50 — 0.3413 = 1587. 
P(B) = P(u < X <p +0)= Р(0<2<1) = y(I) = 03413. 
P(C) = P(u- 6 « X < p) = P(-1« Z «0) = y (1) = 03413 
P(D) = P(u-20 < X p - 0) = P(-2«Z <- 1)= (2) - v(1) 204772 - 03413 = 0.1359. 
P(F) = P(X «y -20) = P(Z < - 2) = Р(2> 2) 05 - v) = 00228. 
Note. P(A) + P(B) + P(C) + P(D) + Р(Р) = 1. 
5* p= рүү <3137}= Р(Х? +1<3137}= Р(Х? $3136} = P(-56 < X < 56} 
= Р{—10.6< Z < 0.6} = ү (-10.6) + ų (0.6) = 0.5000 +02258 = 0.7258. [draw Fig.] 
6*. Put Z = (X — p)/o = (X — 1)/2, then X = 1 + 2Z. Now 
р = КО у Ш VS VU. 
= (0.2734 — 0,0987)/(0.5 + 0.1915) = 1747/6915 = 0.2526. 
Py = Р{2<-1/2|121>1/4) = P(IZI» 1/4, Z <—1/2}/{1- Р(121< 1/4) 
= Р{7 - 1/2) (1 - Р(121<1/4)}= 10:5 - v (1/2017 11 -2y(/4)] 
= (0.50 — 01915) / (1— 2 x 0.0987) = 0.3085/0.8026 = 0.3844. 


7 


> 
r1 
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T: loan (х-н) 
7*. Let gx) = P(x «X «x«1]-], fladz, f= TW, exp е 262 | 
For max. of g(x), g'(x) = 0 and g"(x) < 0. Now 
g(x) = fix*1)-f(o):g"x)- wy (G —p) f(x) - (c 1 — и) f(x + t)} 
o 
g'(x) =0> Gee t+ py -(x- u)’ — х= р- іт. 2" M= rgi [те "^ Іс? 42x. 0. 


Thus, for x = u — (1/2). the probability P(x € X € x + т) is maximum. 
Sec. 16-31. Page 494 — 


1%, If с, and o, аге the S.D.'s of Universes A and B, then we are given that c, = ko,. 
If y, and y, are the maximum frequencies of А and B, and if N is the total frequency 


then [$16.30(4)] 


ya = E oe i a = ky > y=. 
X A O e uc К.Д 


2*. We are given that и = 50, PE. = 13.49. Now 
О, = p - PE. = 50 – 13.49 = 36.51. Q, = и + P.E. = 50 + 13.49 = 63.49 


P.E.= (2/3) с = с = (3/2) (13.49) = (40.47) = 20235. 
M.D. = (4/5)с = (4/5) (20.235) = 16.188. 
Mode = Median = Mean = Mode = 50 = О, (median). 
Now Cum. frequency = 1250 = 1 (5000) = + total frequency . 
Hence, the variate value must correspond to the lower quartile Q,. That is О, = 36.51. 


Sec. 16-41. Page 496 


1*. We put Y = kX? ; then 
-х?/2 1 


E tY —E(e" d m m es aa ayap | 
(е ) ( ) [. J2n Jizan !+ Jen и, [4 x-u 


M(t : Y) 


(Lee ig) I^. 


11 
Thus У ~ гат 1, X. 


Recall : Y ~ gam (a, А), then cY ~ gam(a, A/c). Now Y is gam B 1) . hence Z = 2Y i5 


gam( x) 
z any 
2*. For Мр, o^) we have M(t : X) = exp (ut + 40°r°). Hence comparing p = 3. С = ^ 
so given variate X is N(3, 4’). Now, letting Z = (X — 3)/4, ie. X = 3 + 4 Z. 
р =P(-1<X<9)=P(-1 < Z < 3/2) 
= y(3/2) + (1) = 0.4332 + 0.3413 = 0.7745. [Draw Figure] 
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. Here M(x) 


(2)! exp (—x? /2), Ах) = (2л) m (x =p)’ /2]. 
Хх)/ф(х) = exp (=p? 72) ем. 


Now 


2o 1-90) ab 
EM) = [oso fled =e" | 1 eoe" d. 


grating by parts now yields 
d 


17 
e" " E(y) - \ - Ф(х)] “| + : b e ф(х) dx 
" = 0 y [m.g.f. of N(0, 1) with t =p] = ре". 
BED. 
Г) = Е(е") =Е(Е(е*12= 2) [Ву Double-E Rule} 
= E[E (eiri ).Е (e rz Уй == eee +z) daz M Ee" 7) zu "2 
inuity Theorem for m.g.f. we һауе W ~ №0, 1). 
ty = а — X. Then, using EDU s EO, doe s => az=2p. Also 
Var (Y) = Var (a - X) = Var (X) = о. 
Соу (X, Y) = Соу (X, a - X) = -Var (X) < 0. So руу <0: 
= 2и – X is the r.v. asked for. 
B E = и = 0, [r = 1], hence the given conditions amount to 
e = 211/27 (r!) and jo, =9. 


© "rd {{° Шү. 
Mò) = DE Lohn 


ом, 1), hence variate X has p.d.f. f(x) = (dx) an." N o «x«oo. 


veer 220° hence by comparison, we conclude that 


fe) ч е = е Тат 
n NO. 1/2k2) and so M(t : X) = ee) Re 
(+Y)= мо: ‚ХуМа:У)= e P sd А 248 [Ьу indep.] 


_ мо, 100) and 9G) - (0 Vv Y, ent 
ў ЕХ =} trivially from Reproductive расу. 


nos n.r Ime К а a ig (Def) 
| ны үс" "d ji 
YE inem Je @=in 


~ 


in THE 
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‚278? ООЛ ы элө үх dx 
кы [n kt Б)! ji rE It н "x | Jan 


ail»? 
, 0a? o e’ dz 1/2 2a0 \| 
= X. И 2 = (1—20 RES. |\ 
M(it) exp ( 5 Jf. Jm 1-20 | ( ) G E 7 | 


(1— 20). exp [Өа* / (1 – 20)]. 


ки) = In Mat) = [042 (1 - 20)] - 2001-20) =a? Ў (20У +5 3, 297 
r=0 r=0 


k, = Coeff. of (0 /r!) 22^ а2н1+ 27 - (е – 1)1= 27710 – DT (1 + ra’). 


Sec. 16-51. Page 498 


1*. From E(X – 10)' = 40 follows E(X) = 10 + 40 = 50, i.e. p = 50. 
Thus E(X — 50)* = 48 => р, = 48. But pi, = 30°, hence 30° = 48 => с = 2. Thus X ~ N(50, 4). 


2*, E(Y) = 1o 7)E(X- р)? = ($6 7)c* = 1. 
E(Y?) = E((X - p)*/40*} - (1/46) E(X - pt = и, /407 = 3/4 
since for Мр, o?), ш, =30*. Thus Var (Y) = E(Y) - E°(Y) = (3/4) - (1/4) = 1/2. 


Sec. 16-56. Page 501 | _ _— 


1*. Let T, and T, be the total travel time for the cars A and B. 
Then with obvious meanings of the symbols, T, = Т, + Tiz, so 


E(T,) = E(7,,) + ET) = 3+5 = 8 hrs. УЕ ор = 0,20 o = 0.2 p] 
Var (Т) = 62, +07, = (0.2 x 3? +(0.2x 5)’ 2036 + 1= 1.36. 


(i) P{T,<9} = Ф[(9- 8) / 4136] = Ф (1 / 1.1662) = 40.8575) = 0.805. 
(ii) no T. C ET sE(T;) + EG) = 4 + 2= 6hrs. 


Var (Tj) = сї, +02, = (02x 4) + (0.2 x 2)’ = 0.64 + 0.16 = 0.80. 
Let Z = T, - T4, then Z ~ №8 — 6, 1.36 + 0.80) i.e. Z ~ N(2, 2.16). 
Р(2<0} = D0 – 2) / 42.16] = Ф(—2 / 14697) = $(-1361) = 0.087. 


Ж gi 
2*. The mean and variance of the new (composite) distribution are p = p, + Hy = 29.0 = 


9; +0) =5.16 +9=14.76, o = /1476 = 3.84. Now 1/1000 limits (i.e. 1 in 1000) теат 


that the area cut from each tail is 0.001. The critical point corresponding to this E 
area is, assuming normality, К = 3.09. The limits of our interest are р + ko, which ar 
23 * 3.09 x 3.84 = 23 + 11.87. Thus, the limits are 34.87 and 11.13. 
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Е 
3*. Denote the marks in the given subjects by X. у ^ и 
Т = Х+Ү+ 7. Now, jects by X, Y, Z then the total marks are given by 


E(T) = E(X +Y = 
( + Z) = 150, Var (T) = Var (X) + Var (Y) + Var (Z) = 625. 


А ? 
Thus T is №150, 25°) by additive pro | 
perty. Now us N(O "Lf 7 ^ ge 
(а) P(T = 180) = P((T- 15025 > 1.2) = DONE CARS me aes 
(b P(T < 90) = P{(T – 150/25 < –2.40) = 0.0224 


4*. Let U= ЗХ + Y, then E(U) = 0, Var (U) = 96? +0? = 90 
Let D be the region bounded by the parallel st. lines ЗХ + Y = 10 and ЗХ + = 5, t.e. 
5 < U € 10. Now Z = (U -0)/ V90 ~ N(0,1). [U = V90 Z.] 


p= P((X,Y) eD}= P(5«U «10]- P((5/490) < Z < 10/490} 
= P{0.53 < Z < 1.05} = (105) -w(0.53) = 0.3531—0.2019=0.1512. [Draw Fig.] 
5*, p = P(1.202 < X/Y < 8318 x 10°} = P{tn 1.202 < (in X - Un Y) « 4 + (п 8318} 
= P{0.08 < U < 7.92} (D 
where U = (ln X -àn Y) ~ №7 – 3, 3 + 1) = N(4, 4) by closure property of N(u, o^). 
Thus letting Z = (U - 4/2 ie. U = 4 + 2Z, we get from (1) 
p- P(0.08 « 4 + 24 < 7:92}  P(-196 < Z < 1.96} = 0.95. [Z - N (0, 1)]. 
6*. he E(Y) = Ус; E(X) = Ус; p; ; Var(Y) = De, с? = c^ (say). Thus, by hypothesis 
9с =p, ie. o = Н/З. 
By Closure Property, Y ~ Np, o°). Put Z = (Y- ufo, ie. Y = p + (и/3)7. 
PIO < Y < 2p} = PO < p + (w3) Z < 2p) = Р{—3 < Z < 3} = 0.9973. [Area under 3-с limits]. 


Sec. 16-73. Page 512 


1*. Here ф(х) = (42x) ! exp —x /2). Put = 1/[@(b) - Ф(а)]. Now 

M. i изү S PUMP епу glej- eu) 
EN = f yg) dy - ^ |, уФО) = my BENi Jan ФО — DO) 
Converse. Let g(y) = fly)/[F(b) — Е(а)] =k f). where k = [F(b) - Е(ауү'. а<у< Б Бе 
the p.d.f. of a truncated variate Y. alongwith E(Y) = K[f(a) - fb). 


fa- f(b) p p IDD =, fa - (= fyf dy. 
FO- Ра) ^ ^ уфтад ^ 10 70 wie" 

Differentiating partially w.r.t. ‘b’ under integral sign : -/'(b) = bflb) > f (byftb) = —b. 
Integrating : On f(b) = -ip +constant > f(b)= Kee" 
b (may be function of a). 


Я her te K is a constant independent of 
_ |у Jan. Hence fb) = (21) st” рр 


*'f'isapdf. [^ f(b)db=1 > К 
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Had we differentiated (1) partially w.r.t. ‘a’, we would have got 


fla) = ( 2n y e", Lube qx d. 


It follows that ‘f’ is the density function of МОО, 1). 
2*. (i) Let X ~ N(0, 1) and Y - N(0, 1) be independent variates. By Double-E Rule 


EE, (el X=x)j= Е, [E, (e^ "ES E (ax ) 


Ere”) = 
vss MP (ух b e dz 
o 020212 € o € a < » 
= X ad = — = es РЕ АУ (2 X | | 
е р ann тйл lo Tan i-r "e 


(1-12)? [since area under N(0, 1)-curve is unity] 


S. РТА: s 
As (1 — 2) '? can never be expressed as е 7 it follows that XY can never be a normal variate, 


Note. Ete”) can be evaluated without conditioning ; but conditioning speeds u 
p 


evaluation. 
(ii) Let X and Y be independent variates with p.d.fs. 
ЛО) = Ит П Tee? fo = (102), у>0 


The p.d.f. of Z = XY is given by the standard formula 


fo =f. у (=) p00) Aw 


Now, f,(w) = 0 for w < 0, and f, (z/w) = 0 for 0 < w < Ie INiHence 


ade ке Б ш. 

oq we ""?9 dw EU rs we c PS дю 

f) d ie 2 30-9». X 2 E 2 e 
wo n4Jl-(z/w^) TO Jw -z 


Let w? — 2° = 20°, then w dw = с2 dt and we obtain 


f@ =o mew Drs 
iw Sr E d 2 bu E (2) = Ут 


nov2 


It follows that Z = XY ~ N(0, o^). 
3*. For each л, let е (х) denote the p.d.f. of X, and F'(x) = f(x). If h(x) is the p.d.f. of 


N(O, 1), differentiating the given relation, we get 
g(x) = [(n—1)/n]h(x)+n' f(x), V n 
Consider the Ch. Function of X,, 


—0» -0 


$ (t: X,) че Ее) = j" e" goar) eh(x) dx +2 [*, e" f, (x) dx 
- [n-D/n]e ^? + (1/n) 6 (:Y,) E | 


‘Since 1ф (C: Y)ls 1, lim (1/n) 6 (t : Ya) > 0, as n — о. 


n lim ф (t: X,) = lim (1 - n`’) e~ 7 *lim(1/n)$ (t:Y,) - e^? = Ch. Fun. of NC, 1) 
зу Continuity Theorem, limiting distribution of X, is N(O, 1). 


s. Fo) = Fs») = PU? 211y) -1- po? «y 21 py"? «X « y) 


T I-2P0sXxy*)-1-2[» foods. fox)= Lem 
oV2n 


UIS we get, 


ОЕ” fedes ДЕ: Jenny emos, олус 


p 


-x° /20? 
Me” oy =” 2777 | " 
EN 502-1 o Jan a 
^ —2ab 
L4 —(х?/2в?)- (t1?) v д2 - (b! Ix?) “үне | 
x Um E e dx, [ е ах = 
1 1. 2 ‚ vn NDS = evils 
: © o42x (2/4207) 
Ee E 
pas. к. fx? o pe^ d -tlo 
- Ee") = Ee" )2 [Le ———=4х= е. 


oJ2n 

1 with (1). We have avoided the use of contour integration. 
Е.Х, x,/ Х?Х? + Х} X? + ХЗХ then (122) = E(X. 
Окшуу = EUX 90:17 X3) 0 1X) 


E Im e rtm e Tlo g Tanla: „ИР iav ng 


E 4 
ЛА 


ПЕ 


mw- p м ч" f. fiw) = еу А "20. 


e 


(clans (noy m) AA 


pg” ios m 9 € DS co. 


a k = 1, 2, ул ме independent, hen 


die ЖА = E n 
„ыт, Sa 2 | a 


ME n 5 1 . а у 


Е, jin See rt 
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6*. Let Z= (X - pio, ie. X2 p + oZ. Now 


M x -(x- uy! /26° o —;2/2 i(u*oz)!c? 
tx“ 1с е ml EIU E p dz ge L) 


х [у Vy _ iX o x = — 
M(t: V) = Efe” )=E(e™* '° )= fe ppn » 


2 2,2 2u?r? 
міс) МЕЦ Ас n te 
== | [ (0-20e 1-2) с? | 10-206 


ant dene) £> 2ш wl ut pho 
Na CL d-20e| azo’ ? 
2ш 
= =o 
where и Е d^ ES 


Substituting into (1) this exponent, using dz — du/4]1—-2t we get 


4 uin X t1 —21)] ТЕ 
ме: v) = PIH? Q- 2067] (s e? \ exp 1/0 -201. [ 2 Жж? 
4 Д-2 жт 1-21 20° ) 
= (1-214)? е^ К? (21/0122) = 0 - 20) ' - 1] 
r - od ry 
= (1-257? e? LIC. xt ауе AED 
r=0 r=0 


e е^ 2220/2 с Ёё ‚ү—(1+2/)/2. SK 
0 = pa =) = У p,(1-2it) mee, -0 
Е г= 0 ; 


r=0 
To find density of V we use Inversion formula to get 
1 po -į < 1 e e *2r 
AP» LE amet a= Ў p {Ep em а-у ar} NS 
r=0 


pt i qe 


Е 2 үч — (5; 02002 


Using (6) we instantly obtain 


-w2 r - (V2) -XÀ.,-M2 ,-v/2 -w2 r-l 
e (v) * uk е е v 
y др м cm epa co > HN 


7*. Since X is N(u, o^), Дх) = (o V27)" exp (-(x - p}? /20°}. Let z = (x - ufo ie. x = p + 0° 
The total probability of the event A, i.e. P(A) is given by the Partitioning Theorem : 


e € x—p)?/20? 


P(A) = [, f(x) P(Alx) dx = еы (1— e^) dx, 


exp [-1 (2+ ko) – uk + 1 K*o*] P 


Р -y/o а t-i -uio J2n 
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| H e "2 
т y(#)-exp(- pk a. 1 39K Mr b = udin P du, (u=z+ko) 


OR ro. g(t мв «fr aa | 


| Since X ~ N (0, с?) , E(X) = E(X*) = 0, E(x’) = с, (X^) = 3с“ 
E. =X + Y, E(Z) = E(X) + E(Y) = 0 


(2) = E(X’ +Y’ +2XY)=0 * c E?) + 2E(X) EY) = o? +o; 


PREZ = 3(0* + of +26262) = 304 + (V4) +60 EY?) (E(Y*)=304] — «(0D 
(Z) = E(X « Y)! =Е(Х*+4Х?Ү +6Х?Ү? + AXY +Ү*) 

, = EQ) + 4E(X") EY) + 6E(X?) E?) + 4E GO EQ?) +Е(Ү*) 

t 30° +0+ 60° Е(У?)+0+Е(Ү*) -3IE CZ, [by (1)] (2) 


re, fla) = (Мол) те, ул) = - f), ФО) = FO) (1) 
5 T ако t Tun by o th 
ral TE = (2-4) e - лод ) f(x, [by (1)] 
TA , 1 

o 4|f9|.fe.59.-(.1])no ^ my a» 


5 E 
ate (1) and (2) in the range (x, ©), use f(oo) = 0, to get 


EU. à fo. 
Ве) ur лоф: £2 (v LE 


Bly") < 1, (1 + y D) > 1, these relations yield 


| f(x) 
3 EE ^ 0, and by Squeeze-Principle, this gives 
šil- - Ф(х)] 
T€ y д m ‚+ к). = b, 
b) provides : 1 об) - у" f) 
rigor lim x.r(x) = 1 


шы im ана, as x — оо]. 
poi. -- 


5) ata 
х | 
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i An es KJ is 


+ 5X, Eu Ia X) 


10*. We follow m.g.f. technique. The m.g.f. of 
M (t, буз, ty) = Ее" 
wt Y,)] 


= E(exp (Y, 4 t4 (Y, +Y) + 300 +h +0) * +0, (Y, + 
wth, y 


= Elexp [(t, 9.06) Y, +(% +... +), + (Ь ttf) +. 
= exp i [(t +. +t)? (t5 teeth) +..+(@,„- +t,) t), [using m.g.f. of N(0, 1)] 


Now put г = t, =... = f, = t/n” ; then 
M(t: S /п^?) = exp [5 (t° / n) [m + (n- Dp ou 22 +17]}=exp[(n+ 1) 2n + 1)/12n7] 


As n>, M(t: S, m” — ехр[2 (1° /3)]; so $, dn. — N(0, o^), where Bios 1/3. 


11*. From X, = Y, X, + aYy 4 Y, X,-a ^Y, + aY, + Y, etc., we find that X, is a linear 
combination й Ta ре Which are EOM odit variates. Hence, X, is a Gaussian 
variate. And Е(У) = 0, v, provides E(X,) = 0, Vn. Further, 


E(X’) = Eu, Yd E(X, ,! +2aE(X,_, Y,) + EW) (1) 
Expressing X, _ | in terms of Y, noting Ey, Y;) = 0 (i < j), we find that E(X, Y,)=0. 
E(x; y= a E(X ж: D +1; hence lim E(X) =a’ lim E(X? ) + 1 (as n > œ). 


This gives : lim E(X?) = lim 32 1/ (lAa) =o". 
Now X, ~ N(0, с,2) so M(t: X,) = expl} o? £^] 


lim M(t:X,) = lim exp [1 6; t]=exp[} o*t] 


noo 


Thus, X, 4 > N(0, o^) where с? = 1/(1 – a’). 
12*. Write A = [2nJ4()] and set x — В = Ө, and use exponential expansion to get 


E(cos X) = Af, cos x e! Pd = Moor " cos (В+0)е*°%% dO 


= Af spro] Z ES s. D x ^». (cos В cos — sin В sin Ө) cos" 040 


0 


Since the integrand is periodic function with period 27, shift by B can be dispensed 
with. 


s E(cos x)= A D ^ fo" (osos Q)"! -sin Boos" OsinOydO=Row 5 e = os cos 0! d&. ~) 


[р T sin Ө (соѕ0)' d0 = o 


| 


S n 
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E эл " F- I M 

Now lı = h (c0s8)'*' dO =2 l'(cos oy: 


| 
сте" ditm (sinp) *! 2 
: = Jens? )'* d$, [0 = (1 / 2) 4 o 
н E Б : E integrand), so reject r-even v; lue ) | 
is odd use uplication Formula. i alues in (1). When r (= 2n = 1) 
o, 2n В ( I Е. 
hy = 4h (sin $) cos? pp = SLO/2 Tin + 1/2) _ 34 т Г (2n) | 2n n(2n)! (2) 
AT (n+ 1) п! 921-1 rn) | an "n | (nly? РА 
90 r4] 
. Е(соѕ X) = X cos B — 2n NA 2r 42 y ,2r +1 n(2r + 2)! 
ag 2 оттуу" (€050)''  do- AcosB Y, А стт т 
re (E Т, AEST 1)!] 
[n — (r+ 1) in (2)] 
E 2n cos В o0 (k/2y**! J,) Jk) 


OT TO = p (cos p). [p= 


rz r! 


А 20... : cos(x- c 1 x А JAN 
E(sin X) = A f Een dx =. |. P sin eof 2 а [x - В = 9] 


EU р \ 1 
=^ у, "i L (cos B sin Ө cos" 0 + sin B cos’ *! 8) q0, [Dropping В from range of periodic functions] 
т=0 °° 


These integrals are evaluated above. Only sin B occurs in place of cos B. Hence 
E(sin X) = p sin p. 
[For properties of periodic functions, see p. 417 Real Analysis by the Authors] 


Appendix E, Page 520 


I*. Let X - N(10, 0.01) and set Z = (X – н)/с i.e. X = u + oZ = 10 + (2710). Thus [Draw 
Figure] 
р=Р(99 < Х <1022) = P(99 <10 + (2/10) < 102) = P(-1« Z «2) 
= y(2)+ y(1) = 04772 + 0.3413 = 0.8185. 
2*. Let X be the length of the bed (in cm). Assuming a normal distribution we require 


to find a value L such that P(X < L) = 0.95. 
: 0.95 = P(Xs.L=PiZs L- 172)/8.5), [2 = (X - n/a] 


Standard values give (L — 172)/8.5 = 1.645 [draw Fig.] so that 

172 + (8,5) x (1,645) = 172 + 13.9825 = 185.98. 
Hence, if the firm makes beds 186 cm in length, then no more than 5% of men will 
find themselves too long for the beds. 
3. Let x denote the height of an individual, then by 
а 2=(Х - 68.22)/ /108 - If p denotes the probability 
p» then 
| P 


hypothesis X ~ N(68.22, 10.8). 


that an individual is over 6 feet 


P(X 2:72) P(6822 + 7.108 > 72} = P(Z > 115) 


0.5000 — V (1.15) 0.5 — 0.3746 = 0.1254 [Draw Fig.] 
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tisn= 1000 p = 125.4 2 = 125 


It follows that the number of soldiers with height over 6 fee 
4*. Let X be Mu o^, here u = 15 ; с = 3.5. If n is the total number of observations 


then we are given that 
nP(X > 16.25) 


P{X > 16.25} 


647 [Z=(X- uo] i 
P(Z > (1625 — 15)/3.5] = P(Z > 0.357} [Draw Fig) 
0.5000 — (0.36) = 0.5 — 0.1406 = 0.3594. 


1800.2225 = 1800. 
be. x= 78 + 112. 


li 


Substituting into (i) we get n = 647/(0.3594) = 
5*. Let X be Mu, с>) u = 78, o = 11, put z = (x – p)/c 
(i) When x=90, z = (90 – 78)/11 = 12/11 = 1.0909 = 1.09. 

P(X > 90) = P(Z> 1.09) = 0.50 — y (1.09) = 0.5000 — 0.3621 + 0.1379. 


Hence, of the 1000 grades, 137.9 i.e. 138 were above 90%. 
(i) The probability of one being among the lowest 10 grades is 10/1000 = 0.01. 
This gives 
zi 2.33. (x — 78)/1J. 

7х= 78 — 11 х (2.33) = 78 — 25.63 = 52.37 = the highest grade of the lowest 10 is 52%. 
(iii) О SPE = 20/3 = 22/3 = 7.3%. 
(iv) We require 450 grades to exceed p. The probability of one being among these 
450 is 450/1000 = 0.45. Thus vy [(x – 78)/11] = 0.45 which gives 

re 78911 = 645 ТЕРБЕ 010635) = 78 + 18.095 = 96.1. 
This is the highest percentage for the range above the mean. From symmetry, we have 
450 grades below the mean and their lowest percentage is 78 — 11 x (1.645) = 78 
— 18.095 = 59.905 = 60%. Thus the middle 900 grades lie between 60% and 96.1%. 
6*. The number of candidates obtaining class III is 600, which implies that the area 
to the left of X = 50 is 0.6. For N (р, o 2). Let Z = (X — р)/с. The figure reads 


w{(S50—p)/o] = 0.10, v[(60 — 1)/6]- 0.45 "oy 
We are not given variate-values corresponding to these areas. Hence we interpolate 
linearly to get the required values. Linear interpolation is 


А-А С; P 
——- = — A=A = 
ДА, laum [ rea, z — Variate value] 
4 0.100 — 0.079 22 0.7 * 
(1) 011876070 3200 = 02+ == 13 0.254, (0.254) = 0.10 
r 0.450 — 0.445 2—16 0.5 | 
SET E i alot - e = 0.45 
(il) 0455-0445 = 17-16 —=iz=16+ Т; 1.65, i.e. y(1.65) = 0.4 


Using these values in (1) we get (50 — н) = с(0.254) and (60 — u) = o(1.65) 
Subtraction gives 10 = 6(1396) or 6 -10/1.4- 7.16. 
u = 60 - (1.65) o = 60 — 11.815 = 48185 = 482. 
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the central 50% area under Мр, с?) lies between Т the 


р + 2/3 с = 48.2 + 4.733 giving the 
aries 53.01 and 43.55. Hence roughly speaking ; мй. Si mb 
marks between 43 and 53. To be vire E£hly speaking about 500 candidates sec 


p = Р(43 < X < 53) = P [(43 – 482)/716 « (X - р) /с < (53 – 482)/ 716] 


= P{-0.73< Z < 0.67} = (0.67) + (0.73) = 0.2486 + 0.2673 = 0.5159. 
Exactly 516 candidates secure marks between 43-53 range. 


T. If X denotes the marks obtained by a student then X is Му, o^), where р = 65.2 
and б = 5. If p denotes the probability that a student sected at random has marks over- 


or 
75, then 


| p= P(X>75)= P(Z > 196) = 0025 [Z = (X - 65.2)/5] 

| | | w, the probability of getting 3 students scoring above 75 marks is a binomial probability 
: P(Y 23) = “С, q! p! =10(0.25)' (0.975? 

and the upper limit of foot-length x are : 


E 
A t 
А 


E. 
" 997, so that 3 women in every 10,000 requiring a size larger than 8 
E" f . | -al Limit Theorem. Normal Approximations 
JA eer "T . 
* (! 
= j Sec. 17-32. Page 534 | 
ME af t yor x where X, ~ Pois(3) are i.i.d. variates. Then 
Var (X) = 3n. Thus 5; = (X — 3n) / J3n and S, —> №0, asn > оо. 
1) 4-1 (4) <0, Var(X) SEQ) 21. S, = X, + X, +... + X, Then 


ш 22. LA 


= 


Y 


[S; is standardized variate] 
Jw ^y = Мы bosma] — 


i SE Laer. ER NE O ТИЕ 
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6 (1:57) = o(t/ Jn: EX) - Ly C/ Vr] = [cos (t / /n)]" = (1 (0° / 2n) + O(1/ п)\' 
where we used series expansion of cos (t/ Jn). Now use Euler's limit, as n — co. 
lim ф (т: 57) = lim[1— (£^ / 2n) + O(1/ п)]" =e" = Ch. function of МОО, 1). 


It follows that S" — N(0, 1) asn— оо, thus showing that C.L.T. holds for the Seq. (X). 


- X-0. evn af 
ж, мфй eee BY LL) [Z ~ N(0, 1)] 
3*. P(X > є} B z4 че а plz SN (by ) 


Thus P(X >£} = 1- PIZ x (eJn/o)) -1- 6 (eV n/o). 


Since 1 Ф) ~x" (J25) | e"? [816-73, Example 9] it follows that using x = ein / c, (1) holds. 


4*. The WLLN show that X —— р in the sense that the P(X -ul> =} 5 0 as n > o. 
By Chebyshev's inequality : P(X - ul» e) &o* / (ng?) show that the rate of convergence 


is that of n |. However, C.L.T. provides a more precise estimate of the rate of convergence : 


p(X, -ul> e) = PIS; I> fae} ele E 


E "24 


e[- са ( = 
LT Олуп | с: 
where we used $16-73, Example 9 : P(Z > k) = фК/К. 

5*. Let p be the required limit. Add – o? to all members in (1), then multiply by Jn to get 


2 2 2 2 
pas im e [is oca en wo) NO 
n 


Let Z,-(X,-p)-0/; then E(Z,)=0, 
Var (2) = Var(X, - Ш)? = E(X, – pt - [E(X, -) T =1+0* -o* = 1. 
Let S, XZ,;;thenE(S,)-O0, Var(S,)- n, whence the result (2) becomes 


p= lim P{-1<[S, -E(S,)]/ Var (S,) <1} = lim P{-1< S; <1}=2y 


= 2 x 0.3413 = 0.6826. (Draw Figure) : [Бу C. L.T.] 
6*. M(t:T, = Mit: Уп (5, п) = 4nI2]- e^"? M(rI Jn:S,) 


: Л п 
e"? гг: п: ХО)" = a MET (Put t / Vn = 20) 
Ру rid tivn )” 


= {(e° — e~°)/ 20)" = (sinh Ө)" /0" =[1+ 07 /3!+ 0* /5!+...}" 


2 n : ] 
lim M(t:T,) = lim [ em 1) = exp (t^ / 24) =ехр (ot /2) (say) 
n>% пэ 24п п 


Hence, by Continuity Theorem, Т, > N(0, o?) as n > ©, [o^ = 1/12]. 
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lim P(T, <u} = f" £ үт ' 
n 2 oo ^ dz. 
J2n o © J2n 


që, în Y, = Cm (n X, +... + ên Х,) = (1/n) (T, + T+... +T,), [T,= X)] 
ET) = E(n Х,) = н (say); Var (Т) = Var (un X): o? <0, by hypothesis. 
If oe E T,, thenE(S,)=np, Var(S,) = no^. Now 
gx = SLCEGO ny, пы тшше) tnr) pae 
Var(S,) суп ae a ee 


For large п, using C.L.T. S; = [o^ tn (kY,)”"]~ N(0, 1). So if fis the p.d.f. of N(0, 1), then 


in(kY,)" n "m le 
inen n = [“"° о) ах => PUY, Y" «n- |" fo) d. 


So ЕДІ) = Q[(nr/o], Z-(Y,)", k=e". 

8*. Consider an i.i.d. sequence (X,) with common p.d.f. f(x) = х^ (ün xy,e«x«o 
where k is a norming constant. Being a sequence of i.i.d variates, Lindberg condition 
is automatically satisfied. Further 


dx » е dz 
xi n xy x) = k f, 2 s [z — бп х] 


This integral is divergent as 5 > 0, hence E(IXP*?) is not finite. Consequently, 


Lyapounov condition does not hold. 


Edit) -[ 


9*. Let (X,) be a sequence of independent N(0,6?) variates where 
o) = Lo;-2'/4 for k22. 
Let S, =X, +...+X,, then E(S,) = 0 and B; = Var (S,)=14 (1/4) [27 +2? e... 42^] 22". 
Further, Var (X, | B,)- сі / B; 22*14.2*! 21/2, it follows that (X/B,) ~ МОО, 1/2) 
As $* z(S /B,) ~ N(0,1) for each n [by hypothesis], the sequence (X,) obeys C.L.T. 
© EU. iim о 
n» 15451 Вт иба 179" 2 


(ii) max P (0X,U B,) 2 €) 2 Pll X,\/B,)2e}=1- P(IX,/B,I«e]20, — (Non-zero) 


Thus neither (F) nor (UAN) conditions hold. This implies that (L)-condition also does 
not hold. However, despite these facts, the sequence (X,) does satisfy C.L.T. 

Note. Y = (x уву N(0,1/2), so letting Z = (Y -0)/ 40/2) = ҮЗҮ, we get 

Püri«e) = püzicJ2e)-P(-J2&«Z«42s)-2v (V2) < [use in (ii)] 
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Sec. 17-53. Page 540 ——————— 


1*. Total of 7 occurs (with two dice) with probability p = 1/6. Hence X ~ bin (600, 1/6). 
Hence p = np = 600/6 = 100, o? = npq = 100 x 5/6 = 225/3. Using bin (л, p). 
110 : гч 
P(90<X<110) = X (u^ are p* [p = 1/6, q = 5/6, n = 600 
k=90 
This evaluation is not pleasing. We use C.L.T. 
Write Z = (X —np)/./npq =(X —100)/4500/6. Thus X= 100+ Z4500/6. 
P(90€ X«110) = P{-1.095 < Z < 1.095} = 2y (1.095) = 2(0.3630) = 0.0726. 


2*. Here Y = (X/n) is proportion, with E(Y) - E(X / n) = пр/п = 0.52. [X ~ bin (n, p)] 


Var (Y) = o? / n =npq/n? = (0.52) (0.48) / n. Now by hypothesis, using C.L.T. 


Y-E(Y) 050-052 -24n 
0.01 = i PEINE Inst c oo 
P(r «;) Py o, NH | кс 


where Z ~ N(0, 1). Using Tables of Normal distribution, 


—QXh = 233 => 4n- (233)? 82x48) = n-3387. 


452 x 48 
3*. (a) p= q-1/2,n-10.Let X ~ bin (n, р); P(X 2x) = "C, (1/2). 
Р(Х =Зог40г5) = P(X =3)+ P(X = 4) + Р(Х = 5) 


=(5) [(5)« (5) (5) Poe iia ose 

(b) Here np = 5, с = Jnpq = 425 215845; Z=(X-np)lo = Х=5+15817. 
We utilize continuity correction to approximate discrete distribution : 
POSSE X < 53) Р(2.5<5+ 1.5817 < 5.5) = P(-158« Z < 0.32) 
(0.32) + \р(1.58) = 0.1255 + 0.4429 = 0.5684. 


There is an excellent accord between the two results. 


4*. Неге p = P{ wearing matching socks} = (’C,+°C,)/'? C, =31/66,q¢=35/ 66. 


Now half of the time is 1 (365) = 182.5 days. Let X be the number of days she wears 
matching socks. Put Z = (X — np)/o, i.e. X = 365 x (31/66) + [4/365 x 31 35/6617 
17.1.43939 + 9.5349268 Z. We require : 

1- P(X «183) 2 1— P(X <182+(1/2)}, [Continuity Correction] | 
1— P(17144 + 9.535 Z < 182.5} = I — P {Z < 11.061/ 9.535) | 

1 — Ф(1160) = 1— 0.8770 = 0.1230. E 


P(X 2183) 
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as pi —————— 
* pp = 0.30 g = ) i | | 
5*. Неге 1 BAN Ms E ее 100, x > 40. We need P(X > 40} which we approximate 
by Normal probability law using continuity correction. Here the lower limit / is given by 
l = (x-np-+)//npq =(40 -30 1)/ 421 = 2.07 
ГА > - E ' 
P(X240) = Р(2> () = P(Z2207)-1- (207) = 1 - 0.9808 = 0.0192 


de p) " N I 
Thus, P 0.02. Hence it is doubtful whether so many glass panes shall be smashed at 
this distance. d 


6*. Let X, represent the weight of ith container and let S — Ж + Xt IPS. 
X ~ N (150, 152) are independent variates, we have 

E(S) = 25E(X,) = 25 x 150 = 3750 Ib, Var (5) = 25 Var (X,)=25 x 15? — c = 7516. 
Let Z= [S - Е(5)] /с, i.e. 5 = 3750 + 75 Z. If p is the probability of overloading the truck, then 
p = P(S > 4000) = P(3750 + 757 > 4000) = P(Z > 3333) = 5 - y (333) = .5 —.4996 = 0004 


Thus, on the average, the truck shall be over-loaded 4 times in every 10,000 occasions. 
7*. (i) Let а be the 90th percentiles then 0.90 = ®(a,)=@[(a—500)/100]. (by 
standardization) Consulting N(0, 1) tables we get (a — 500)/100 = 1.28 > a = 500 + 
100 x 1.28 = 628. 

(ii) Let О, be the upper quartile, its standard value being Q', = (О; – 500)/100. Then 
0.75 = Ф(0;) = Ф[КО, – 500/100]. 

Consulting N(0, 1)-tables we get (О, — 500/100 = 0.67 = Q, = 500 + 100 x 0.67 = 567. 


If continuity correction is applied Q, = 567.5. 

Since the lower quartile is symmetrically placed, we have 
(500 — Q,)/100 = 0.67 = Q, = 500 – 67 = 433. 

If continuity correction is applied, Q, = 432.5. 


Chapter 18 : Uniform Distribution. Exponential Distribution 


Sec. 18-42. Page 552 


1*. Let X and Y denote the arrival time of the man 
and the woman. Then they will meet iff, | X — Y | < t. 
Hence the probability p is given by 

Measure of shaded area 


EXU-risd- Measure of total area 


= |- (1- f)? = (2 – t), hours. 
When т = 10 min, p = 11/36. 
2*. Since X ~ Unif (-b, b), its p.d.f. is f(x) = 1/2b, 
~b<xcb ; fix) = 0, otherwise 
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2 dx 


So 3/4 = P(IX|>2)=1- P(IXI<2)=1- Р(25 Х S2)=1-2}, 2р: 


Thus: 2/b= 1/4 => b=8. 
3*. Since X ~ Unif (1, 2) ; Дх) = 1, 1 < x 2; uy = (1 + 2)/2 = 3/2, 


1 3 3 
77 pix>z+3h= [ өш а= 2- (z+ 2) 


Thus z= 1/4. 
4*. Here py = (a + by2 = 1, с“ = (р – а) A2 = 4/3. Chebyshev’s inequality 
P{X-plec}<o?/c? => РИХ- 1226} <1/4. 

Thus, the upper bound to the given probability is 1/4. 
To obtain the exact value of probability, we not that f(x) = 1/4, so 

PIX =1124//3)}= 1- P(IX -11«261) 21- P(-161« X < 3.61} 

= 1-—P{-1<X <3}=1-1=0. [^ x e (-l, 3)] 
5*. We need p = P(L or M) = P(L U M) = 1 - P(L' N M^), Ah 
P(L' (| M') = P{min (X,,..., X,) » - b; max (X,,..., X,) «a] = P(-b « X; са Mi) 


= [[P(-b<X,<a)=[(a+b)/2c]", (1S jn) 
j=l 


а du a+b 
b% 2 
6*. Solving the given quadratic equation we get x = 1[а+ ҹа? — 4b]. Thus, the roots 
are imaginary if b > (a’/4). We find this probability : 


: | 
(ps = Р = [бизд dadb- ч «уд d |: f.b)- fi) f)- 1.1 


P(b<a’/4) = P {roots are real} = 1/3. 


since P(—b < X; < а) = |н . Substituting in (1) gives p = 1 — [(a + by2c]. 


2 sin (1 
7*. The Ch. Function of X, ~ Unif (5, 1)is 6 (t:X,) = 2, e"dx = oe 


Since X,, X,, Ху are i.i.d. it follows that à (r: X, + X, + X,) =[ф ХГ 


2 sin (1 2) | Aa i PB 
EX = mes з Е ЖААЛАР dec ES Тусп з=... 4 
294 | 7 a Te |g o ' 


» SI d 
E(X^) = yi — 
Thus, E(X ) = Coeff. of (it) ! = i920 ^ 80 


8*. (i) F(x) = [* 6-2) dt=3x" - 2x5 ; С(х)= f 30 - Vt) dt 2 3y - 2y^^. 


Setting F(x) = G(y), since both are Unif (0, 1) variates, we get 3y — ay? 
=> у= x. 


= 3x° ¥ 2x 
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O _ ——— 
- M(t :Z) = PES um [! ur - 22 
(ii) E(« = 1, e" | (бх бх? ) dx 


= [, e" dz = cR 
This shows that Z ~ Unif (0, 1). 
9*, (i) F(x) = Дете". Choose a random value y € (0, 1) and put 
уу = l-exp(-x)) => x, --[n(1- у); j212, 3... n. 
x ra’ а 
Gi) А0) = |, ee ar=1-(2) 
Choose a random value y є (0, 1) and put ys1- (аху э х = all - y)". 
10*. Here domain of Z = X — Y is the square OABC | 
ФСЛХ rD = f f el" dx ay 
= 2f s ее» dx dy 
= 2[ e" dx[ e dy 


= 2 | Bus id 


ito | 
= ak Hazte enr? 
it it 
To find moments, we expand exponential and get 

UCM ic cm NE I Co 1 


2o ре ens. NU 
ф(1:141) = EL or 2l x21 22 n! (n+2)(n+1) 


ш, = E(IX - Y" =Coeff. of D" /n!=2/ (n+ D (n2). 
11*. Let u = xy, v = x/y, and invert them to get x = (wv), у = (uv) ^. 


Әбу) |2010" zW Ws а 


1/2 ,,-3/2 


i E l Thus, dxdy- iv^ диф. 
O(u, v) Luv)” -iu v M 


І 
d 2 


The region in the u-v plane is trivially obvious, as 
meer psysi=> 0s Jav <1, 0€ Jul v <1. 
le.O« uy «1, 0 <и < v. [Shaded part in Fig.] 
Since X and Y are indep.; their joint elemental p.d.f. is 
dP (x, у) = file) ЛО) dx dy = dx dy 
dP,(u, v) = Ly" du dv. ad) 
zi the p.d.f. of U, we integrate out v from Eq. (1); 
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dP,(u) = 5 du un 1 dv= _ (пи) ди, О<и<1, = gg (u)-7-Un и, O<usi. 


To find the p.d.f. of V, we integrate out и from Eq. (1) ; thus 


dP,(v) = d^ du= 5 dv; 0«v«l c | 
=> g (v= 


dv v-] 2 
= — =— dy, 1<0< 00 
2b n du "e \ ү 


12*. If X, ~ Unif (0, 1) then p.d.f. of S = X, + X; + X4. is [8 18-41(3)] 
glu) = 1и?,0 <и<1; gu) = – Qu – 6u +3), 1«u«2, g(u)=4(u- 3),2 <и<3, 
Now W = 25 – 3 so 5 = (W + 3)/2 ; hence 
glu) du = (1) [00 + 3)/2]dw > f(w)=3 gl(w + 3)/2]. This yields (A) 
The c.d.f. of W is given by 


(1/48) (w +3)’, ~3<w<-l 
F(w) = 4(1/24) (Qw—w") + (1/2), alaws] 
(1/48) (w — 3) + (44/88), l<ws3 
Using Normal tables [®(w)] we get 
w 0 0.5 1.0 145 2.0 
F(w) : 0.50 0.68 0.83 0.93 0.98 
P(w) : 0.50 0.69 0.84 0.93 0.98 


Comparison reveals that 2W — 3 is really an excellent approx. for №0, 1). [Compare $16-61] 
Sec. 18-82. Page 564 | 


1*. Counter Examples : (a) Let X and Y be discrete with p.m.f. 

| pedes PO = 0) 3/5. „в Dee P(h= 1). = 2/5. 

Then mode (X) = mode (Y) = 0. Now let Z = X + Y. Using indep. (X, Y) we have 
BED PED, Y = 0).= 9/25 
P(Z= 1) = P(X =0, Y= 1) + P(X = 1, Y = 0) = 6/25 + 6/25 = 12/25. 
PO PO xL Ж ж bs 425. 

Obviously Z = 1 is the modal value of Z and' mode (X) + mode (Y) = 0 # 1 = mode (X +). 

(b) Let X and Y be i.i.d. Expo (1) variates ; so that F(t) = 1 - e" 

F(r = + = t=0n2 and thus med (X) + med (Y) = én 2 + (n 2 = (п, 4. 
Now Z = (X + Y) ~ gam (2, 1), so f(z) = ге `. [§8-18 (3)] 
If med Z = m, then 


1 СЕ. : 
2 h ze ! dez [e he] =1-(m+ be. 
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2 tee . If we tr N 
me las гу m= in 4, we get +=0n2, an obviously wrong result. 
Hence med X + med Y + med (X + У). 


РЕ ‚= Хх LAE | | | 
2": Here Дх) = Xe 7,0« x <0, = 1/3000. Let Y denote the daily consumption of milk, 
then X = Y — 20,000 is the exponential variate of interest. The stock shall be insufficient 


on any day if consumption on that day exceeds 35000 gallons. Hence the probability 
p for this event is given by 


p= PAY > 35000} = P(X > 15000} = [Ae а= fre? dz= е", (=) 


15000 5 € 


P{Stock insufficient on both the days} = Mg t p=p us re 
3*. Неге f(x) =Ae™, x20, and so F(k) = PX «k) 21-67, PX» К) =1- PCS O7 67 
[P(X > k)/ P(X < )] e ^ /(1— e) =a, by hypothesis. 
Thus e"  -(14a)a => M-in(1*al) 5 x, 2X'la(1*a ). (кел) 
4*. P(X < 1) = Р(Х > 1) = 1- Р(Х < 1) = Р(Х € 1) = 1 (by transfer). Also F() = hoi 5 
Thus 1-e* 21 ie. е^ -1 > A=0n, 2. So Var ) 2 1/X = 1/02. 
5*, M(t : Y) = Efexp (—t/A)0n F(X)] = Elexp én [FOO] = EFODO” 
= о а-г)". EFRI = VOD] 
Thus, Y ~ Expo (A), i.e. fly) = "rob TEX 


XQ LECT E y = Xy id 
6*. FA) = РІГ <) = Pr sip - ul ene dedy- Mise ^ [e T, dx 


MUS (1 Se are he dx – № ре", e "Чоҳ 


REDL Eo = udo 
ШЕ Ko = (dFldt) = Vl + Di ere. 


" . 
Note. Е(Т) = КДП (+ усо; i.e. E(T) does not exist. 
-1 xn 
7*, Here À = 1/n, so that f(x) =" a; X20. . 
Let X, ~ Expo (A), 1 < i < k, be independent variates. We want : 
р = P{First failure occurs within m months} = P{Atleast one X; < m} = 1 — P (X; » m, V j) 


— m P(X, >т, X, "d Mic ds X, > m)= 1 - [P(X, 2 m), p X; are 1.1.d.) 


-mink __ 
Since Р(Х > т) = 1 - F(m) = em hencep=l-(e ) =1-е 
V*. (a) the expected length of an interval is E(T) = 1/ = mean Expo (A). 
PT 21/3) Jp, ^€ dt -e2037. 


ША 


—mkin 


| PIT <(1/2)} 21x P(T > (0/20) = 0637 Р, say. 
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The required probability p, is now bin (5, р); here л = 5, x = 2, р = 0.63, д = 0.37 so 
that p, = °C, q? p? =10 x (0.37) x (0.63)? = 0.2010. 


9* Let u = х- у, у = у 80 that x = и + у, у=у. Also | O(x, yy (и, у)! = m hence 
ахау = dudv. The domains of definition of (x, y) and (и, v) are shown. 


I. y=0, 0€ x «o5; > v-0, О<и<о. Ш -pDEyeos -»v--u 0sv«o. 
Ш. 0€ x «o, у= 0; > 0<и+у<о, v=o, IV. 0OXy«o, x=% => u*tv«o, )<у<о, 
The joint elemental p.d.f. of indep. X and Y is ar (a, y)-ope е dx dy; 


In terms of new variates : ар, (и, v) = a e ?" e 9*9 qu dv. Integrating out v we obtain 


—(a+B)v 
P(u) = «Ве du.4 ^" "i a RS Thus dP(u)= 
e +B)v 
be dv, u» 0. 


10*. Probability Integral Transform shows that c.d.f. Fy(x) and Fy(y) are U(0, 1) variates. 
Now 


Fy (x)= f Ae" dt 1-6, x20; Б, (х) = 0, otherwise 


[a/(a+P)Je"", u<0 
[a/(a+P)Je“", u20* 


Fo = [52 E а= y^, О<ух F,(y) - 0, otherwise. 
Thus Z = 1-е is U(O, 1), W = JY is U(0, 1). Changing W to Z provides the relation 
y=[l- л This means, if X has prob. law f, then [1 — Е, shall have the p.d.f. “g” 
11*. For a mixed variate X, | 
£i to bas 
ме: X) -Ee) - peu а divi Г, + Yt A - -i[m.g.f. of expo (A )]++[m.g.f. of Pois (А)] 


xU 


= 1(1- Ar)! +4 exp [A(e’ – 1]. 
We may expand these exponential functions to obtain 


2 
Mee hoe? eere ) 


X H 
= parus ония, ^ |+ er BE | 
’ 


Thus p = Coeff. of t = A, р = Coeff. of 7/2 1 = (3/2) А2 + 1 Var (X) = 4 A+A) 


S 
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Note. Using moments of expo (А!) and Pois (А) 


л we can directly evaluate E(X) and Var (Х). 
Xe © x e A \ 


dx + 1 À 
+5 5, = 1(А+А) = А. 


{= () х! 
EX’) = 1[2А + (А + А2)] = 3/292 42/2 
12*. Let W = max (Y, Ү,,. 


Thus EC) = 1f; 


» ctc. 


ы Yy). Firstly, we determine W. Let F(w) be the c.d.f. of W. Now 


Ү «w,N-n) 


sin 


F(w) = PIW <w}= У е 
IW <и) ZPW sw, Мп) = УРИ Sw. Y, Sm. 


© 


РО, О Ven) IG; QT Р, [ У, іѕ іпаер. of N] ...(1) 


леер, = P(N = n] and G(w) = Р (Y, < w), i 

саз G{w) are given by (Y, € w}, is the c.d.f. of Y, ~ U(0, 1). As such the 
Gw) = 0, w<0, G(w)=w,0<w<l, G(w)=1,w>1. [cdf. of 000, 1)] 
Substitutions into (1) now provide 


it ‚ F(w) = 0, м <0; F(w) = Ум" b, O<w< 1; F(w) = У(1)" И w> 1. ia) 
: E c 1 = 1 1 oo 1 oo n Waf 
А = — = l ado qu yu w € 
— hi Хр, Pim e-i" Ме. ЭШ о еър" 


F(w) = 0, и < 0; F(w) = (е – 1)/е – 1), 0 <и < 1; Е(и) = 1, w> 1. [by (2)] 
f(w) = Е'(и) = ее – 1), 0 < у < 1. 
$ (t:Z) =o: X -W)-6(:X)6 Ct: W) (7 Х 15 indep. of W)? ...(3) 
We now calculate the Ch. Functions separately. 


каве") = X e- Dee" 2 e- n XT" Cree} 
I. m- m- 
Es E Кеи деса а а у 

к. $c = е" 1 = pipe’ oso "ЕГА" 
РТУ Ба Шади 

Ке: УТ erpi r4 [by (3)] 


This shows that Z ~ Expo (1). 

AGERE 3 e-l idi АД k aI es Axes 

B. p c f Ae de = hat dx = E ‚ру=1 n WU 

еса l : (X, Y) ~ Trin (3, Py» Р» pj. Since qu = 1 - Py = We, 4 = 1-р; = (е-е + e 
помп result [§ 15-34] gives 


ў E Corr (X, Y) = = A p.p» ! 402 --(e- 9I (e - e 0). 
Же a Y) = 0 need not provide independence of X and Y. Thus, it is impossible 


ermine the joint density of X and Y from the given data. 5 
"A Xand Y independent, then Кх, у) = fy O f = ae” be", x 20, y 20! 
here X an | 
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Sec. 19-15. Page 571 ——— 


Chapter 19 : 


X) = uA, Mode = (о — 1)/A, hence a = = ai, b= (a = 1)/). 


1*. If X is gam (a, X, then E( 
X? = (a/d) (1/1) = a (a - b). 


these give (1/A) 2 a — b. Now Var (X) = a/ 
[For mode of Г(о; А) see Ех. 1, Set Ex. 19(a). 
2*. With given u’, we determine the m.g.f. of X. Thus 


una Se = Е (n+ t yr = x ("haunt art. 
n=0 n! n=0 n! k! nzÜ n 


where we used Neg-bin Expansion. This is the m.g.f. of gam (К + 1, 1), hence 


fos (ky **? 47 x* JT(k + 0), 0Sx« о. 


3*. Let Z = (X - uyo ~ N(0, 1). Then Y= Z?/2A, and so 


MES 
2 21; „2/2 5c aie gi. d 
Mt) = Е(е2 4) = е = 55 (1- 0A) 


qiie ed 


Thus Y ~ gam (1/2, А), hence Var cd = @/ = A2. 


4*. If X is gam (r, А) then 
a (r+ »i Ге. +1 2 


_ (® EE C 4 uu Dx r9 zt 
E(X) F> b | T(r) ) dx = ES HE et FE T(r) рас Seal LE (r) 
Now if Y is N(p, o°), then Z= (Y - н)?/25” is gam ME ys 
Е((У- Ш) = cJ2EQZ)-o42 (T +1)/Г(1)}=в(2/л)'”. 
5*. The joint p.d.f. of X, and X, is 


iy eau EUST de do, «x, x, «o. 


Also X, = уу, х= y (1-7 y.) so that 
a(x, X2) » Ox, / y, Ox, [ Oy, ET. PL. j 
O(y,, У) Ax, / Oy; Ox, / Oy, у! "ТИ ad 


Thus, dx, dx, = | y, | dy, dy,, and the probability differential element for у. Y2 n 


gy, У) = Me?" у, 0« y, «o, 0 « y, <1. [g(y,, у) = 8,01): 82621 
This shows that Y, is gam (2, A) and Y, is U(0, 1) and that they are indep. distributed: 
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6*. Since X is gam (т, 1/а) its т.р. Ё. is M(t : X) = (1 — at)” iE) 
M(t:X) = M(t/n:X, + Х,+...+ X)  LM(t/n: X) = 11 (at/m] ", — (by (1)] 


This shows that X ~ gam (mn, n/a). Hence Y = X has 
Ду) = (п/а)"" e "nh ggm- /T(mn), O«z«o. 
7*. The m.g.f. of X ~ Expo (А) is M(t : X) = (1 = Ay. 
3 M(t:nÀX) = M(t: X, а. Х, 4 la. X,)=[MQt: X,)]" =(i—t)” ү? X; аге i.1.d.] 8) 


This shows that nÀX ~gam (n,1). Now consider c.g.f. 


Ка) = (n M(t:nAX) = -nün(1—- t) 2 nX(t / r), 1&r «oco 
А БЕ WF len; СИ и, 
So E(nÀX) = п, Var(niX)-n > Е(Х) = 1/А 


Уаг(Х) = 1/пА2 => S.E.(X)=1/avn. 
8*. Here X ~ gam, (a, A). Now 


M(t: X) = EG) тусу E ate 0-9 оў! ду [Put x – Ө = y] 
Du S c6 or a] A e" (a) 
- ) n 
vM NS (a) (X-0* 
e ge que. * #3) 
Observe that if X ~ Expo,(A), then 
Mi) = e"[1— (АТ. ...(2) 


We now determine the m.g.f. of X as under : 


M(t:X) = M[t:(X,+...+X,)/n]=M[t/n:X,+...+X,]=(M[t/n:X,))" 
= (e t1 (А), =e" [1-(t/ Any". [by (2)] ...(3) 
From (1) and (3) we conclude that X ~ рат, (лп, nà), hence the p.d.f. of X is 
fo) m (A nye gy = OY Tad, y2O, 10. 


9*. The Chernoff Bound valid for any variate X is P(X >с} € min е“ M(t: X), [0<t <h]. 
Since X is gam (a ; A), M(t : X) = [1 — (t/A)]™ and this bound provides 


Р(Х 22a /А}< тїп е?“ (1—(r/2)] * (l1) 


Let w= [1—- (0А) e" ; then 
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y) 1 
dw ow 1 а?у Е ev -1) | чү -+} — аі 
е1 + 
dt А Fears | к is^ M À dt À À 


Put dw/dt = 0 to get t = 2/2, and then (Z^w)/(dr) > 0 at t = 2. 
Thus, w is min. at t = 4/2 and min w = (2/e)". Substituting this into (1), the stated result 


follows. 


Sec. 19-25. Page 577 ——————— 


1*. With the notation of $ 19-24, we have m = 6, M = 12, h = 12-6 = 6, р = 8. 
u=m+(ah/c) > 8=6+[6а/(а+Б)] = b=2a. 


Substituting into the expression for variation (С.У. = o/p) we get 
ee nS 
Э Ы аву eb Pj By vos 
В (2376253) 10-6 2 
Th E PIDE iz E 
E P NUN DO жы Za49 M IG 3 


This result may be read from Tables of Incomplete Beta function. 
2%. If X is B, (a, Б), then m = (a — 1)/(с - 2) ; writing и = a/c this gives m = (рс — 1)/(c — 2). 


«Hg. 7 245244 Tiei E EL 
pen X ae Set: Р) =1т PEST XM E d 


The function f defined by (1) is continuous in the interval [0, 1] and hence must attain 
its supremum (and infimum) at и = О огр = 1 (and p = 1/2). Thus, 
Suplm- pul = 1/(c-2) Inflm-pl=0. 
3*. As usual, F(t) = P(X < t), so 
Gyr) = P((1- Х) <) = P(X2(1-] 2 1- P(X <1-t}=1- F(10- Р). 
a) = G'(-F'1-1-f- t). 
Now f(t) = 1^" (1-2! /B(a,b) => (0) = 1-0) ABa, b); 0<t<1. 
4*. Let u = ху, v 2 x sothat = v, y = uly. Easily we get dx dy = | J | dudv = у! диду. The 
region 0 < x < 1 and 0 < y < 1, in the x-y plane transforms to (ће region 0 < u < l; 


u<v< 1 in the u-v plane (Draw Figure). 
Since X and Y are independent, their joint probability element is 


d e aj nab-1 р- 1 4-1 
О а АА он MI SL wr! udy; 
а DIM xou? = 


where КО! = B(a, b) . B(p, q). p+q=a. Integrating out v, we get 
dF(u) = Ku”™' du f! (Yn v)! (у-и)! dv [Put у-и = (1 – u)t] 
= Kudu -uy** p rr! Q7 07! dr Ku?! (1 -)**7! da. BO) 
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T 
~ | һ + ‹ 1 
и” 10) 


is gives : Хи) = — <a )«u- 
This giv f TEE , 0<и<1. 


since [B(b, q) / B(a, b). B(p,q)] = 1/ B(p,b + q). 
————— Sec. 19-33. Page 579 
1*. Let X ~ B, (a, Б), then its probability differential is 
dFy(x) = x"*'(1— ху?! dxi В(а, Б), 0«x«1 (1) 
Put x= 1/(1+ у), ie. y-(1—x)/x (2) 
Then | dx| = IdyW(1 y)?.Further0 < х<1 => O<y<o. 
Substitutions from (2) and (3) into (1) yield 
dF) = у?! ау! В(а, Б) (1+ y)"*’, O<y<a t) 
Thus Y ~ Bj, (a, b). The reciprocal of Y i.e. Z = 1/Y gives 
dFz) = z^! dz/ (a,b) (1+ 2)"*"; O«z«oo 25) 
Thus Z ~ B,,(a, b). It follows that corresponding to one variate X ~ B, (a, b) there 
corresponds a pair of B,,-variates. 
Converse : Let Y ~ By (b, a) with probability differential (4). Put y = (1 — x)/x from (2) 
then | dy | = | dx Ух” and (4) reduces to (1). That is 
dF,(x) = x* (1-3) dx/ В(а, Б), 0<х<1 NU 
Thus X ~ B, (a, b). Further, put x = 1 — w, to obtain from (1) 
ағ уби) = w (w)  dw/B(ab, | O«w«l ...(6) 
Thus W ~ B, (b, a). It follows that corresponding to one variate X ~ B, (a, b) corresponds 
a pair of B, variates. 
2*5. Letu 2x у, v = х/у, then x = uv/(1 + v), y = u/(1 + v). 
(х, y) дх/ди dy/du wü*v) (+v) и 
Olu, v) Ox/0v ду/ду u/ (a 4 yy -uf à Гу) | (Ivy 


Thus, dx dy = [u/(1 + v)^] du dv ; Also, the region 0 < x < o, 0 < y < o in the x-y plane 
transforms to the region 0 < u < oo, 0 < v < in the u-v plane (Draw Figure). 


Since X and Y are independent, the joint p.d.f. of X and Y is 


sax а-1 -ày „В-і 
ex dx ey dy. orb acl yh! 6*9 де dy, [K а (a) 5] 
Г(а)/А ' F(b/X 


i.e. ари, у) = Katt? e? uota yt! qu у)“ qu dy, 


dP(x, y) = 
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If Ru, v) is the joint density of U, V this can be expressed as 


pare ,7Àu ,a* b-l у“ | у 2 
f(u, у) = | r = filu) . f3 (9), Oem y« oo. 
Г(а+ b) B(a, b) (1+ v)" 


If follows that U and V are independent variates with p.d.f.'s as stated. 

Note. "Quotient of two independent gamma variates 15 а B,-variate" IS again exemplified 
3*. Let u =x + y, v = x/y, so x = uv/(1 + v), y = uK(l + ЗА РАК е у) (Ех .1) 
The region x > 0, у> 0, x + у < I transforms to v 2 0 Ozu £1, 

The joint p.d.f. of U and V is g(u, v) = flu, v) ! J I. 


4- 1- 2- 
us m ge : O«u«l, u»O. 
È B(4,1) BQ,2) (1+ vy* 


Thus U and V are independent ; U ~ B, (4, 1) and V - By (2, 29i 
Sec. 19-43. Page 582 


I". Here Ex = [© f(x) x! dx - |, shew x^ dx 


When k is odd, the integrand is odd function in ] — оо, oo [ and hence E(X” ') = 0. Thus 
E(X) = 0; whence simple and central moments coincide. Note р = 0 is axiomatic. 


T(2k+1)_ 2k! 
32% mU 

So, E(X?) = Var(X) 22/ X, E(x*) 224/ X. FurtherE(Y) = a+ cE (X*) =a+ Qc/ X) 

4 12abX + 2bcX? + 2acX?) = а? + (D) + 2ac) (2/27) + (24с 1). 


TLF х? e dx= 


E(?) = E(d + PX? «X 
Var (Y) = (252 /А2) + (20c? /X*). 
E(XY) = E(aX + bX? + сХ?) - QD/ M) => суу = Е(ХҮ) -Е(Х)Е(Ү) = 2b/ X. 


Thus, руу = су, сусу = Ab/ (Л? + 10c’). 


Check. с= 0 => p(X,Y)=+#1, as it should be. 
2*. The density f(x, 9) is an even function of x, hence all the odd order simple moments 
are zero. So E(X) = 0 = p. The even-order central moments are given by 
4° n Аі ө 
Hy, = —— nae ass ge x? " exp (- Ах!) dx [Put x 2 z ] 
_ I e окне ог ge X ГЇОл+ DO) _ Ian» D] 
Le Г (0) d 4 (2n+ 09 E 2e r(0) $ 
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na mU RTT — 
In particular, p, = F(30)/A" Г(Ө), p, *F(50)/4" TO) => P, = p/p} =T (50) (0) T (30)] 
B T | MI ae [n + 00] 
+ CMS us — ii, = = 2 
MGA Ма:Х) = 22Р» TO, 2л! y 


Mec [Lap (0, A)] 


Special Cases : fix, D 
f(x, +) is N(O, 1/24) ; f(x, 0) = 5, Ixl«l. (Uniform) 


Sec. 19-60. Page 589 


1*. Here f(x, у) = f,(x) fj) = (24 xy Y" etg (- dm — 52), x20, y 20. 
Let z = xiy, м = у, thenlO(z, w)/O(x, у) | = у ' Thus, the joint distribution of Z, W is 


ZI LEE 
fiz) = QAJzy! f° exp {-Vw (01/2) + Vz/3] dw — [Vw =u] 


2/2)! (4/2) + Jz/3]?, <>0. [gamme integral] 


Fidei, [1/2)* Jz/3]^ dz. [Put (1/2) + Jz/3- t] 


ges. dt _ 
? 2р 
2*. We firstly obtain the "Survival c.d.f. of Weibull (k; p, a). 
k К 
P(X>1) = [юа = [re à "EN 
a 


So, P(X>t) = exp [-t] eh 
Y PLP Sop 2 PLN Pek, S uA y] 
= P(X,»y).P(X,» y)... X, > у) = [P(X > yr 
= exp [-ny] = exp [- no t ual) by (2), ...(3) 
Result (3) implies that Y ~ Weibull [k ; p, al(n)" ah 
3*. Firstly, we determine the p.d.f. of Z. Let G be the c.d.f. of Z; then 
G(z) = P(Z < 2) = Р{ тах. (X, X,, ..., X) Sz] = Р(Х, < 2, і = 1, 2,..., п} 
= P(X, € 2) P(X, < 2)... P(X, < 2) = [F(2] [`: X, are i.i.d] 
where F(z) is the common c.d.f. of X's. Since X ~ Expo (A), F(x) = 1 ~ e", x > 0, and so 


G(z) = 1-7%)", g(z) =G'(z) = nde (1 ег)" 220. 


Е(е'2) = ү [ге uo Xe „ү а= n fu"! (1 РА we du. [и = 1 — 


M(t : Z) = nB[n, | — (/A)] = пГ(п) F[1 — G/AJ/T[n + 1 — (7X)]. 
Let k= 1 — (0А); use T(n + k) = (n+ k 2 1) (n + k = 2)... (k — 1) К. ГО); whence 
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—(nek-D(n*k-2)..(* DK | ( „K ‘yf | tN)! k 2 
n "m e. ) 


n 


Я +I _—_—_— 
[M(t:Z)] = n(n — 1) (n ~ 25.41 


a. 


1 
Ө Ө -9) _@ 


where t/A = Ө = 1 — К. We now determine the m.g.f. of Y. 


M(t: Y) = E(e' ^ +(1/2)Х, + ee =E(e™ ) E(e" 1) Ее") (X, are 1.1.d.) 


(es (es) (ay feo) 


From (1) and (2), it follows that M(t : Y) = M(t : Z). Since m.g.f. uniquely determines 
the c.d.f. it follows that Y and Z have the same distribution. 

4*. By definition р, = E(X') = |? x’ f(x)dx. — [Assuming E(X) = 0] ...(2) 
Multiply stated Eq. (1) by x^" * ! and integrate over (—oo, ©) to get 


Jf ub Ric oT qu TR (by + bx^ + b,x^) f'(x) dx 


Of ни, [x * (b + box?  bx*) FOI, — [Lat 1) x^ 
+ (2n + 3) bx" + (2n + 5) b x^" * *1 f(x) dx. 

Since f(—o») = 0 = f(oo), using (2), this equation reduces to 

by(2n + 1) р, +02, 2n + 3) Mo, ot b, (20 + 5) и, 147 Pons 2: 

аф d'E(e™) ғ 0X, ро jr, . : 

* $Q0-—---———— -E(X'e^)2a| xe" f(x) dx 9e jit " 
ОД шат ( [xe FQ [0 = it] .. (i) 
Put df/dx = f', multiply the Pearson differential equation by е? and integrate over (—%, ©) 
to obtain 
[° e™ (by +b,x + b,x’) f'G)dx = |? е (a х) f(x)dx. 


Assume that integrals vanish at either terminal limit, use (i) for R.H.S. to get 


[e™ (b, + bx bx?) f oor. - |? e" f(x) [O(by + bx + b,x?) + (b, + 2Ь,х)]ах=аф+® 


or -[0(b$ + bo’ + bj") + (bib + 2b,9')] = ad + $', [by (i)] 
Le. b" + (1+ 2b, + b,0) o' + (a+b, +b,0) = 0. 
Differentiating by Leibnitz Rule n time w.r.t. ‘0’ we get 
600" + пф"? + [Q^ (Le 2b, 0) nb] + [8 (a b, + b0) + nhà" 179 


"(0) 
— put Ө = 0 so that ф'(0) = р’,. And if we shift the origin to the mean, then e 
= р, =H,. Collecting the like terms the last Eq. gives the moment recurrence formu | 


m" 


Solutions to S tarred Problems | 80 o 


[(n + 2)b, + Пи, , , + [00 + Dd, + alu, + при 


к) Wege 


n-l 


Cumulant generating function. By definition, w=nd or ф= е“, so that 
Q' ze" y', o" e" (y'' 4 y?) 
Substituting these values into (1) and cancelling е“ (20), we get 


b, (y + y'?) + (1+ 2b, + b) y' + (a b, 5,0) = 0. 43) 
To obtain cumulants recurrence formula we differentiate (3) r times and use Leibnitz Rule : 


b OD,v'' + Div?) + (7) by QD, у" D, 7) + (1+ 2b, +0) y" + (1) BW" =0, 

where D, sd 140°. Now put Ө = 0, use (k, = Юу) N this gives 
ИЯ (7 2)b, t K+ rb, (р. ур") 0 = 0. ...(4) 
To evaluate the last term, write y? = VV, (y, = dy/d0) and apply Leibnitz Rule : 
"A = E -1 
X,- OY) = (yy), uw (Tw (67 a) (ур 
Putting Ө = 0, noting (y), = k, = 0, as р, = 0, we get 
-1 -1 -1 
poer bb. SERO \Kjer thay tet АА. 

Substituting this value in (4), we get the result as stated. 


Chapter 20 : Bivariate Normal Distribution 


Sec. 20-60. Page 609 ТУРОН 


1*. sis [urs AIT oy 
J = 5,0)/y1 е u? +y? = (22/6) – 2xy p/ сүв, + (у? /o3). 


Р +у 2y/20.- 


nio c nap ES "y 


Note. M.G.F. method is very convenient. Try it. 

2*. If (X, Y) ~ BVN (р, р, сү, а" p), then f(x, y) = Qno,o, Дер" e 9? 
where 0 = ((x – ш)? /o; – 2p(x =m) (y - u3)/0,9; + (y =m) /o3Y/0 - p^). 
Comparison provides: p, = 2, р, = -3, С = (2n0,0,/1-p? p! 


Ecc UE иле Wiek дк. е, ме ся 
216 2(1-р2)с2' 216 2(1-р2)с2 20,0, (1-р) 216 


(u). f(v) > U ~ N(0,1— p?) and У ~ N(0,1— p?) аге indep. 
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(1—p?)o? =27/4, (1- p) o5. 0,0, (1 - p^) = 18p. 
So (1-9))6262-81-(18p) => р =1/4. 

0,73, 0, 24, C 2 [2n .3.4(3/2]' =1/12/3л. 
Thus, the given BVN is N(2, —3, 16: MAD. 
3*. Obviously, py = 0 = ну. Hence we compare (1) with 


f = Qno,0, 41-0)" exp (I2 /02) + (у /о2) - 2рху/ o252)]/ 20 - p^ 
just to find сус, /1— p? = V3, с2(1- p!) 23/4,01(1- p?) -3p/o,0;(1 - 9) =. 


Solving: 62-4, 62-1, p - 1, Thus Corr (X, Y) =р= +5. 


4*. P(XY > 0) = Р{(Х > 0, Y 0) 9 (X «0, Y «0)) = Р(Х > 0, ү> 0) + P(X <0, Y<0)} 
= 2Р(Х > 0, Ү > 0). (by symmetry) [use Exp. 20-3] 
l 


= 2101/4) + (1/27) sin! p] = (1/2) + x^! sin ' p. 
The other part follows trivially by noting sin! Ө + cos! Ө = 7/2. 


5*, Recall : (Ylx) ~ N(m, c5), where 


m, = p, + p(95/0,) (x - №) = 10 + p(5/1) (5-5) 210,07 =с2 (1-р?) 225(1- p^). 


Put Y*- (Y – т,)/о,, іе. Y 2 10- o5Y*, so that, by hypothesis (writing С = o^) 
0.954 = P(4 < 10 + cY* < 16} = P(-6/c < Y* < 6/o} = 2y(6/o) 
Thus w(6/s) = 0.4770 => 6/0 =2 or с = 2 [From Tables] 
As such, 25(1 – р?) = 9 => р = 4/5 (since p » 0). 
(ii) If p = 0, X and Y being jointly normal, are certainly independent. Thus 
Z= (X + Y) ~ N15, 26). Put Z* = (Z-15)/426 ie. 2= 15 426 Z*. Now 
p= P{X + Y <16} = P(Z < 16} = P(15 + /26 Z*< 16} = P(Z* «1/426) 
= 0.5000 + w(0.1961161) = 0.50 + 0.0753 = 0.5753. 
6*. E(Y | X =7) = p, + p(o,/o,) (x - Ш) = 1 + (3/4) (7 - 3) = 4. 
Var (YIX = 7) = с2(1-р?) = 25(1 – 9/25) = 16. Thus Y/x ~ №4, 16). 
Put 2=(Ү- 4)/4, ie. Ү= 4+ 47 where 2 ~ №0, 1). So 
Р{3<Ү<81х=7) = Р{3 < (4 + 42) < 8) =P{-l/4<Z< 1) 
= 4000.25) + w(1) = 0.0987 + 0.3413 = 0.44, [Tables of №0, 1) Area] 
(b) E(X1y) = p, + (0/5) (у-н) = 3 + (12/25) (-4 - 1) = 39 
Var (X1 y) = o? (1-р?) = 16[1 ~ (9/25)] = (16/5)2. 
Thus (X1 y) N [(3/5), (16/5)2]. Now put Z = (X — 3/5)/(16/5), ie. X = (3/5) + (167/5). 
P(-3 < X < 3 | Y = -4) = P(-3 < [(3/5) + (162/5)] < 3} = P(-1.125 < Z < 0.75) 
= w(1.125) + w(0.75) = 0.3708 + 0.2734 = 0.6442. [N(0, 1)-tables] 
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7*. Compare the given p.d.f. with that of BVN (i), My, с iE py: 
шя PIRE 


f(x, y) = Qno,0, J1- p^)! exp Hes | -®|^— "i Е ura | i | аб. | ш p | 
9, p "WEE | 


Coeff. of exponential : А /2лсс, -1/6n43, А = (1- py". 


2, 4, 2 2 ? 5 е] 7 
Coeff. of x : 3A /6;)=2/27, Coeff. of y^ : +(X? /65) = 1; Coeff. of xy: pX /сүс, = - 1/9, 


Coeff. of x : 2| P1 4 H2 |5. 2| H2 LL | 2 
p—— |= =; Coeff. of y: X i Doe | 


2 
Constant : 222 E "c rod е 


From first three relations: с =3, су = 2, p-- 1, (А 22/423) 


From the 5th and 6th relations : p, = 3, p, = 1. 

These values satisfy the 4th and 7th relations. Now regression of the mean of Y on X is 
E(YI X) = р, + p(o,/o,) (x - n) = 2- (x/2). 

Since this is a linear estimate, the associated M.S. error is given by 


e = 02(1- p) = 41 - (1)1= 3. 
8*. We utilize the m.g.f. of BVN. Let e* = U, e! = V; then 


E(U^V^) = E(e X *^") = exp (цг + uot (o1; + 2p Fh fy +0315) 
E(U) = e" *iei Ey?) =e +91). E(VU) =e"! +" exp[1(o; + 2po,0, + о;)]. 
Thus, Var (U) = E(U^) -EU) «e? ** (e! 1). Var (И) = ei e - n. 
Cov (U, V) = E(UV) - E(U)E(V) = e^ * eei +9 (qom _ p. 


Bir : К бабе Е. 1) 


Thus, Corr (U, V) = Oy Sy E [(е°\ — 1) (e? " ТЫ $ 


9*. (1) M(t,» t) =Е(е" * ^") apat t Y? et} - E(e^*) E(e” ) Ee ^ * ^ 7 ] 
* e) P PAL =exp Ha " 3n +141 A xy 422 7 x5 


For BVN (ц, Ho: n e p), the m.g.f. is 
M (t,, t5) = exp [pity + Hol» + 1(01 t? + 2po,0, fit; + с213)] 
2 2, 
Comparing (1) and (2) : (О, V) ~ BVN (0, 0, 1 + A 1*5 р) 


"rà 


where p=A7/(1+2°), (A? = po,6,). Obviously, when р = 1/2, A = +1. 
(ii) Let U, 2 p, + (oU / J1 X), V, =p, + (o, V/AT-4 А). KEN 


Then E(U,) = р, Var (U,) = of, E(V) =u, Var (И) 2 0 


Thus, mapping (3) gives the required Vl 
10*. Given distribution is the mixture of BVN and trinomial law. Now 


n-x 


M(t,, t,) = E(e^** ^") "а Е? ота f(x, y) di (1 -k) Y А; ght sr р(х, у). 
х=0 у=0 


k [m.g.f. of BYN] + (1 – k) [m.g.f. of Trinomial law]. 
= kexp [tH +p, + L(t} 0? + 2ptt,o,0, +1;0,)1+ (1-  (- p - 4 + pe’ *qe^). 
M(t,,0) = kexp [tu +5 Loi Ё 1+(1- к) (1- p4 pe'y. 
Thus, X also has the mixed density consisting of №(у,, бү) and bin (n, p). 
f(x) = Клс)! exp[-(x – uj)! /262]; - o « x « o, omitting integers 
= (1-—k)"C, p'(1- р)“; x =0,1,2,... 
E(X) = ku * (1 - 9) пр; Е(Х?) = Кот + pp) +01 np +n- Dp] 
Var (X) = k(o? +p?) + (0 - [np + n(n - Dp? ] - [kp  (0— K)npl 
E(XY) = Ә?М(0, 0)/ 0102, =k[po,o, + uus] (1 — К) n(1 – 1) pq 
Cov (X, Y) = E(XY) - EX) E(Y) 
= k[po, с, + ші]+ (1 On (n - D pq — [pis + (1— knp) [ku + (1— gl. 
Now for BVN, (ХТ у) - Mu, + p(o,/o) (у-н), o; (1 - p)] 


and for Tri-nomial, (X y) ~ bin [n – y, p/(1 ~ 4)]. 
Hence, taking into account the factors k and (1 — k), we get 


E(X 1 y)= Кш, + po,0;' (у - u)] £07 9 (n= y) pl- 9) 
EX? Iy) = kot (1-р) +1, +роүо;' (у) ч 

+(1-K (0-5) pl -p-g) (1-4) + (пу) pr(l-gy [т = 
Var (X | y) = E(X? |y) - E! (XI y). 


We do not attempt to simplify this expression. 
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11*. i f(x, у) dy юе лч 


у Кш Ла pu —,1/) iL: 
wn)" p oe" ^ xye 60-504, 


2nd term is odd function of y] 


Z > 
ia e 2 - exp' ў 4) „—х?/2 
tet eret omen m 


I foy» dy dx = 


| 
| 
8 8 
^ 
I 
Ii 
N 


sue f(x, y) > 0 and (2) yields > f(x, y) = 1, it follows that f is a density function. 
Incidently, (1) yields that X ~ №0, 1). Since f(x, y) is symmetrical, we infer that Y is 
also N(0, 1). Notice that X and Y are not independent, since f(x, y) # f(x) hO). 
Remark. Each marginal density is Normal, but the joint density is not BVN. 


N.B. | f(x, у) ау = f(x); J| f(x, y) dy dx» [ f iG) dx =1. 


12*. If aX + bY is the linear combination sought, then 


| = Var (aX + bY) = а?с? + с? + 2abo,0,p=a’ +b +2abp 5262) 
Cov (X, aX + bY) = a Var (X) + b Cov (X, Y) = a + bp, (с = 6, = 1) „(1] 


Now X and aX + bY shall be independent iff Cov (X, aX + bY) = 0, since these variables 
аге BYN. Then by (2), a = —bp and hence by (1) 


1 = b’ (1e p! – 2р?) 2 (1-р?) > b-t(1-p^) "^, a-*p(1-p^) 


Thus, a linear combination L is possible in two ways : 


L-(px-Y)(fi-p)! ^ or. L2 - xy Ji- p? у”, 


13*. The m.g.f. of (X, Y) - BVN (0, 0, Sis 6; р), when expanded in series, gives 
M(t,, t;) = E(e’**"") = exp [L (of tf + 2po,6,tt; + 1305)] 
= 144 (Ft) + 2po,6,1,; + бї; + (сүү + 2po,0,t + буг)” CH 
Since E(X" . Y^) = Coeff. of (titi ! ris!) in M(t, t) 
ЕЮ EOS Б), E =o К” )=0,, ЕХ) = 30, EY *) 2301, 
E(X?Y?) = с2с2 (1+2p°), E(XY) =po,o, 
So  Cov(X, ү?) = E(QC . Y?) -E(X”) E(¥”) = 02 o2 (1+ 2p”) - o? в? =2р?с?! 0. 
Var (X°) = E(X*) -E'(X?) = 304 - 0; -20;; Var (Y?) = 205. 
Corr (X), Y°) = Соу (X?, Y) / [Var (X?) . Var (Y?) =2р2с202/202.с2 =p’. 
14*. (a) Recall that m.g.f. of X and Y is 
M(T, Tj) = E(e™*™”) = exp [1(T7 + 2pT,T, + T; )]. Mi 
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Now the m.g.f. of X + Y and X — Y is 


M(t,, t>) = Eje € * ^w D]z 


[C +)Х (Q4 7 00Y] 
€ : 


— exp G EG, +h) + 2p(t, — t2) (t * 165) * (f, - y]. [by (1)] 


= exp {(1+р)12 + (1 — p)t2}= exp [(1 + р) Jexp [CI - pi] 2 M(t,, 0) М0, 1). 


This shows that U = X + Y and V=X - Y are independently distributed with densities. 


“МАЧ em =02/4(1- р) 
fiu) = 2m p) hh) = m —p) 
The result is otherwise obvious : 
Cov (X + ¥,X-Y= 6% -07 =1-1=0 => py, =0 => Ind (X,Y). 
(b) When p # 0, we can never achieve the equality 


M(T,,T>) = M(T,, 9) MOO, Т.) 
so that X and Y are generally dependent. However, when p = 0. 


N 


Eq. (2) holds [put p = 0 in (1)] which shows that X and Y are independent. Conversely, 


independence of X and Y always leads to p = 0. 
(c) M(t: Q) = E(e'2) = Qr 1 - p? y |" A, e 9? .e' dx dy 
Let x =u/./1-2t, y= v/ J1- 2t, so that dx dy = du dv/(1 — 2t) 


2 2 2 2 
se[-228]- 9 |- 02.5 — 2pxy + y ЕЕ – 2puv + v А 


ә“ 41-р? 


(1-21)! |? уи, v) du dv 


where f (u, v) (Qn J1-p?)"' exp [:(5 —2pup dy? )/ 2(1— p^) 
Since f(u, v) is standard BVN-density, Eq. (4) reduces to 


M(t: Q) 


M(t:Q)=(1—21)! = [m.g.f. of ҳо, 1. It follows that Q ~ y». 
15*. M(T,, Т,) = E(e™*™) = exp [4 (To; + 2po,0;17, +Ty03)]_ [820-21] 
m(t,, t) = Efe’ *^") = Efe" Xo+ Qe) 0а) 0163) = Efel жы! +У(-ь)о3'! ] 
= exp (1t, +) +2р(@ +) -h)+ 7571, Бу (OI 


= [exp (1+ р) гр] [exp (I~ p) i5] = mt, 0) .m(0, t3) 
We thus see that U and V are independent distributed, and 
U ~ N [0, 2(1 + p)] and V ~ N[O, 2(1 - р)]. 


Trivially : Cov (U, V) = (02/67) - (с; /o3)=0 and conclusion flows readily. 


EK) 


...(4) 


D 
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16*. Since X ~ №0, o). Y ~ N(0, 55), so 


„=ь=0, EX) =o, E) =0?, EX’) 


The conditional and marginal densities give 


j0;, E(Y*) = 36; 


E(X1y) = (рс, /с,)у; Var (X1y) =02 (1- p?); 1) 
We now use Double-E Rule together with relations (1) to obtain 


EQCY?) = EEQCY? | y)} =E(yE(x? 1 yy) 


= ail- ph EY?) *p'(or/o)EQ*)-ojoi0-p)*3p'cjo;. (Бу KO) 
one G(X Y°)= 0705 1+2р?) ih 
Since E(XY) = E(E(XY!y)) = E(Y E(X I ))  E(Y . (рс, /o;)Y) 


" (рс, /o,) EY?) = рос; 
Var (XY) = EQCY?) –Е?(ХҮ) 2 сүс; (1€ p^). 
Now Cov (X°, Y’) = E(X?Y?) – E(X?) EY?) =0? 03 (1+ 2p”) - o1 б; = 2р сүс; 
Var (X?) = E(X*)-E2(X?) = (301) - (o2! 226j; Var (Y*) = 265. 
КЕ, заво б 22979192 _ 02, 
PAN — Wax’ JVar Y? 26; 03 
Note. E(X?,Y?) can be had through m.g.f. See Example 13. 


17*. Let us integrate out y from (1); then 


1 e UNDAP] o UDA] 
oo —— € YT E. y 
Гло = Lm. | | 


E ] ie e 0/090 dy 
2x41 -p 


[Since changing у to -y makes 2nd integral equal to Ist integral]. Put y — px = t1 —p’, then 


Ор) - [(y - px! I-P + 2 € * x^ dy 2 J1- p? dt 
-x?/2 at^ /2 e? 
Cum Tm (2) 
і Уб, y) dy " 2n | -0 on ] on 


From (2) we infer instantly that | f(x; y) dx dy = 1, ata Дх, у) 20 Ух, y € R, it follows 
that fix, у) is a joint density function. Incidently (2) yields that X ~ МОО, D. By symmetry 
E of fix ^ 4 L e Y №0, 1). As f, CO fy) + fes у), X and Y are not independent. 
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E(XY) = (4n J1- p?" (ff xyexp[-4 Q(p)] dx dy + J| xy exp [- 3 Q(-p)] dx dy} 

Change y to —y in the 2nd integral, the above Eq. reduces to 
E(XY) = (4n41- p?) [ff xvexp[-5 Q(p)] dx dy - f| ху exp [-5 Q(p)] dx dy} = о. 
Cov(X, Y)  E(XY) - EX)E(Y) 0, =. Corr (X, Y) = 0. 

If (X, Y) ~ BVN (... ;), p = 0 < independence, which is not true here, Hence (X, y) 


is not BVN. 


18*. Let f(x, y) = Ag C ОА) cose x, yeb. [A is Norming const.] 


ЛО) = ae thee А pera dy = Ae 0*9 [x1 A fi (ique а=.) 


n UD Ahh _ exp (у? /203) 
; fi) Халах) V2n 0x 

So (Ух) ~ N(0,62). Similarly, (X! y) ~ N(0,02) where o; =[2(1+ y^]. 
Thus, conditional densities are normal, though f(x, y) is non-Gaussian. 
19*. Recall : max (X, Y) = (X -Y) - 11X- YI 
Let Z= X- Y; then E(Z) = 0, Var (Z) = 1+1-2p=2(1-—p)= o’, say. Thus Z is N(0, o^). 
КА F(z) = (1/ 42x a) e 2", — о Жо, 
Е121= [7 Izlf(2dz-2]; (0) а= с V2/n jj e" du2o42/m. [z -2uo?] 


—oo 


(o2 = [201+ x^] !) 


3 


6i 1/2 
Е [max (X,Y)] = JEX +Y)+4E1Z1=0+ Ee =( “4 


Further, E (max (X, Y) + min (X, Y)} = E (X + Y) = 0. Thus 
Е [min (X, Y)] = - E [max (X, Y)] = - КІ — py/x]'^. 


Chapter 21 : Chi-Square Distribution 
Sec. 21-42. Page 625 — 


15. The pal. f. of X «xia inkl Ke 7 x? 11. AK S [AT (1n) }. 
Py= P{X > xo}= f; sede ame [When n = 2, K = 1/2] 


This result is equivalent to x) = —20n P, = x? =20n(1/P,). When P, = 0.05, this gives 


Xe = 2, (20) = 2(2.9957322) = 5.9914645. 
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c O— 
2*. Here y = f(x) = Axe ,0 < x < о, Differentiations yield 


f'G) = М Xx) ^, f"(x) = А (Ax -2e™, р(х) =0 2 х=1/%, f(a) 2 -X Je < 0. 
Thus, x = 1/À is the mode and since X = 2 is the unique mode provided, we must have 


. So f(x) = Te "x, x» 0 and this incidently is x2,. It now follows that 
Р(Х < 9.49) = Р{х у < 9.49} = 0.95, (from Tables). 
3*. We use the m.g.f. of 4? and p.g.f. of geom (p). Now by Double-E Rule. 
E(e*) = Ep (Ei IN -n))-E (0-202 ?]-E(9)". [0-(01-20 1 


= pl(l-q40)- р(1- 22) /(р- 22). 
Sec. 21-72. Page 629 —— 


2 


= 


2 3 n 
ТК Here o = 1; Y = [(X,, ,- o is [NO, DI’, so that Y ~ xy. Further, Z= 77 


n+l 

Èa, - Xy is ruf р. Obviously, Y and Z are independent. Hence, by Reproductive Property 
= (F+ Z)~ Xi: 

2*. By definition : (п 1)? = E(X, - Xy. = E[(X, - н) - (X - ШР 

X(X, uY + n(X - uy! -2n(X - uy! = (X, =)? - (X — р)? 


(n—1)E(S?) = SE(X, - uy - nE(X - ny! = no? - n(o? /n) = (a- D с”. 


Thus, E($?)2c?. We have used Lin E in above steps. 


When X is Мр, 02), we know that Y = (п – 1) 5° /o? ~X- Thus $264Y / Jn 1. 


e"? (n/2)-1 
У 


с ——E ———————— dy 
E(S) = ТЕТ (УУ) = ST L їй [(n — 1) / ay. 90- 12 у 
| ace Ууну 


"de FOO o" Yr Pe 


Obviously, E(S) + С. 


3*, The p.d.f. of 52 = X (say) is given by [8 21-72] 


. <4 ХЕЧ. 


25; F [(n, = 0/2] 


(n 71/2 (ду -3)2 2 
-1 i exp [-(n, – 1) x/ 201] dx 
dF(x) = [= | рЇ—(т | 
To shorten writing, let (n, — 1)/2 7 a, (п, - 1)/2 = b, (n, – 1)/2 = c. The joint distribution 


of 52, 52,52 for0 « x, y, z « oo is 
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exp (-[(ax / 07) + (by/ 65) + (cz/ 03)]] 


a b с dal phe) c-1 
a n C + у Z 
V Z 


Let u = x/z, 


К ETT. 

O(u, v, w) I2 0 SE | 
EAM z -y/z |= 
ABD eit aso vo rope = 


K ; dx dy dz = w° du dv dw. 
The joint distribution of U, V, W is, thus 
КЕ w)s Xy! yr exp (-[au/ 02) + (bv/ 62) + (c/ 03)] w]. 


ü b С 
where K = cJ (5 (&) I (a) F'(b) E (c). 


С! С; 3 


To obtain the joint density of U and V, we integrate out the unwanted variate W, (О < w < o). 
Ки, 9) Ku ly p w^ t? tc I exp hy E s bv y а) 1 dw 
0 a? 2 2 


= К.Г(а+Ь+с)и ! v! <и, v«oo 
[(au/ ст) + (bv/ 03) + CL o3] <и, 


ye ирц! Г(а+Ь+с) Шт! y Eee 
Por T(a) Fb) Г(с) [((au/ 07) + (Бу! бз) (cl ат i i 


@; „0; 
where a, b, с аге as defined above. 
ai dw ~ Bern, п) 


————— =; m > to verify normality. 
(А + Cx)" п А C 


, 


Note. Use |, 


—— Sec. 21-91. Page 635 


1*. мї ы = 0-20". 


Letting n — 0, this gives M(t: Ж) -]-EXp,e/? which shows that у? is degenerate variate : 


Pp 59) 1. 


2*. M(t: Y) = E(e’) - Ee "*)  E(X') 
2 e yo. ді y DIGn* 1) b 2TGn-t) И. 
Tn) mm ra n) D ү е rG n) 1 
E (Еу) = E(x! . X5) =E(X") E(X;") [^ X, are indep.] 


_2TGath 2'TGn-E PGneOTGn-D py (yy 
T (1n) T (4n) [Gay | 
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3*, Recall that, Y = n$^/6? is Y D [821-70] Hence | 
Е(п52/с>) = п- 1, Var (nS*/o7) 2 Xn- 1). 
Thus, E(s*) = (п – 1) o^ /n, Var (52) = 2(n — D o*/n'. 
Chapter 22 : Fisher-Student t-Distribution. Snedecor-Fisher F-Distribution 


— Sec. 22-34. Page 646 реч TENIS 


1*. (i) Here C is the normalizing (or norming) constant. Now 


Ex" = CL x" 1-22) ах. 


2 


For odd-valued k, integrand is an odd function in (-a, а) and so integral is zero. Thus 
E(X) = 0. Now 


e x? 
Е(Х?*) РЕ 2C J, xk [1-4] Дх=Са?*! f, ;/*0/m-10 уя dz, Ра 


а 


= Са?‘ *! В(К+!, т +1). 


Put k = 0 to get 1 = CaB(1/2,m+1) => C= Va В(1/2, т + 1). AD 
Bio ml  4QT(*2 I(m«3/2 . 4^. 


Б IENE k = V “© PI * 
н = E(X^)-a BG, m+1) “ T(t) Г(К+т+3/2) (m + 3/2)? 


So pt, = E(X?))-a! / Qm 3) > а =(2m+2)p, 
За“ S m7 3(2m + 3) E 9-6, | 
Ш Е) с ОТТ Л От)" 206,3) 


(ii) Relation between X and Т. Using 2(m + 1) 2 n, it is 


{ 0 ү3/2 2 517 
i S ^id, Ls) i m e E US 
= =|1+— , Jn n a ntf n 


Р 2 y é | а+? [ ny &* 0? 
dF,(t) = сі! + 4 a(i Т 1 " Bani) 
Thus, T~ 1, where n= 2(m + 1). 
Special Cases. From (2), 1 = nx^Kal — x°), so at n = 2, (т = 0) 
| $ v2 e C f" dx=Ca(l- 52/3) 
Pp» s: |х а-ал ~ 


n+4 


P(T,»2)- 
[Using (1) with m = 0] 


(3 - 431248 = 0) - 692116) 
When n = 4, (m = 1). 
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pa 


M, 1 546 
PU, 2) = пх (2) ME ch-£ = Jac ac (à - RR E" 


T ES N(u, o? / n, X' ~ Мү, б hence (Х'— X) ~ N[0, o? + (o? / n) which provides 


ME cs Az QOL. мо 


5 o n-D/n | o (n^ 1) 


Also (п5° /с?) = E(X; - X 1o? = (55/6?) ~ka- 


7 (X' — X) 4n(n - 1) 


Т = RUNE JE e d еро . 
Г рр? S, Jn*1 (n- 1) 
3*, Recall : EO. = 2" T(tn+k)/TGn) [§ 21-20] 
Р I(i-r)r(in-r) 
Exi sui 2 § 22-21] 
Rye Grinds EQ | 
(n-1) S* 


Reyes so put 5 = 


Since Tz" and thus 


TAE, 


ша Ө ДЇ Боа qa AEA Л, 
Du (n -1y? hs (n« D^ 0) 
Since E(T) = 0, Var (t,) = n/(n — 2), hence Var (T) = (n – 1)/(n — 3). Now 
Cov(X,T) = E(X.T)=E(X-p)T] (С. E(T)=0) 
E((X - n! Vn/S]=Vn E(X -W E(S"). [- T2 (X – Vn! S] 
;, 2"? fn-1T(n-2)/2] 
Уп (с СЕ Nay VO [Бу (3)] 
Cov (Х,Т) CP ri - 2)] 


С оомат 2; га 


4%. Here, fix) = КП + (х2 п)", – оо « x «o, К^! = уп Ban, 1). 


Let 2 = (п – 1) [1+ (X? /л)]; we find т.р. Ё. for Z. Thus 
E(Z) =E {exp 0n [1 + (X? / n] "^"? =E{[1 e QC sy 


2 t(n - V2) 2 —(п+1)/2 
uS б dx. 
n n 


M(t: Z) 


[by (D, n >n- 1] ...(3) 


pdt 


Here the integrand is Even, so we halfen the range to (0, oo); also we put [1 + (x /) = i/y 
so that dx = [n /2y?? (1— y)"?]dy. If follows that (1) reduces to, putting for K. 
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M(t: Z) = |! ew ! dy 


B(a, "m n, і -I(a)r(i n+5)/V(a++)0 (in) 


(a)? t1 — (1/ 8a)] 


( 1 Ji n 25 | -1 
"m Ш ROME Ind. 
4n ^ n x) l 


We let n — œ, [a ! — 0] then this m.g.f. simplifies to 


[by given approximation] 


-1/2 › : a 
M(t: Z) > (1 -2t) ~=M(t: xi) = Zis approximately y/,,-distributed. 


Sec. 22-82. Page 657 —— 
1*. The elemental probability differential for X ~ B,(a, b) is 

dP (x) = [B(a, b] ! x^! (1 x) ! dx, 0 «x «1. wir 
Let us put z = bx/a(1— x), then x = az/(b + az) and thus 


1-х = b/(b+az), dx -abdz/ (b az). 
The function z = f(x) is an increasing function; 0 « x <1 — z » 0. Making substitutions 
into (1) we obtain 


das ac b jid ab d- а? aid ldz T 
= Ba, b) | b+ az b+az (b + аг)? ~ B(a,b) tua 


This shows that Z is F(2a, 2b)-distributed. 
Remark. If X is B,(a, b), then (1 — X) is B,(b, a) [Vide §19-25, Example 1]. Thus 


| eas ай - X) BOE 0-49 is F(2b, 2a) distributed. 


dP,(z) = 


Z Жа. ах + 
2*. (i) Since X ^f,» its р. d.f. [using (n- 2) = m] is 
ар, (х) = [mB(i, 5 т КАИ т DE. г, (1) 
As suggested in the problem put x = Im(1— y)y ^^, then 
dx = -1т[(1+ y)/ у“ 14у, Le т>) = (1+ у) 14у, 
9! - 2 
Making substitutions into (1), using B(k, k) = B(+ +» К), we get 
1+ 4 (n—1)/2 9^- 3 pS ?dy 
dP (y) = = | ma y) rey err poss aaa =,у>0 
E 4В(1,1т?) y" (+у) B, 1т?) (+y 
(m^ 2/2)-1 
E Bi m^, im^) че уе? 
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This shows that Y ~ F(m’, m^); m. = п – 2. 
(ii) Here АР, (х) = x™”-'dx/B(}n, 1m) (1+ х)", 0« x «1 


Now, B(k, k) = Q^" BG, k) > B&n, їп) = BG, 1/2" '. 
sS 
1 x-1 yo sna ^ | У | e + ] 
= 5 Е > [i+ —| ==. 
y [E => 147 dx = E 
d i JE 4 Ш 
EL ani ganar A 
P 5 = а-л). 


Making substitutions into (1), we get 


см | Ух IE: He. 1 ac dy, – 0 < у<о. 
B(i,in) 1+x ~ Jn ВО, in) n : 

This shows that Y ~ г, 

3**. (i) If X ~ F(m, n) and Y ~ F(n, m), then for any a > 0, P{X > a} + P(Y > ia) = 1. 
Take a = 2.753, X ~ F(10, 12), Y ~ F(12, 10); then p, = P{Y > Па) = 1 0.05 = 0.95. 


dF, (у) = 


(ii) Since 4, ~F(1,n), we have 


= P{-J4747 «t < 44741) = Plt), < 4.747} = P(F(1,12) < 4.747} = 1 - 0.05 = 0.95. 


4*. For X ~ F(2, n) the p.d.f. is 
fi) = VL + xin) P * ', 0 «x «co, [const. = 1]. 


peu (127-012) р." 


If p = P(X > Р), then this result gives р = [1 + 2F/n)| "^. Thus p ^" - ' = 2F/n whence 


F= in[p ^" —1]: the significance level. 


Numbers don't lie, and they don't forgive. (John Updike) 


slesiesiesjesiesiesiesiesiesiesiesiesienienjeoieskesiesiesiesiesiesienierienjenierienienienienienienie 


Anyone, who lives within one’s means 
suffers from a lack of Imagination. (Oscar Wilde) 


Some Useful Formulas 


1. Basic Principle of Fundamental (or Sequential Counting) or Product Rule 


If a complex experiment can result in n, outcomes on the first stage, п, outcomes on 
the second stage, ..., n, outcomes on the kth (i.e. last) stage, then the total number of 
outcomes for the complex experiment is n, . n, .... т. 


Example. If there are four routes joining the places A and B and three routes joining 
the places B and C, then there are 4 x 3 = 12 routes joining the places A and C via B, 
viz. ax, ay, az, ..., dy, dz. 


Basic Rule of Sum 

If an experiment E, can result in n, outcomes, a second experiment E, can result in n, 
outcomes, ..., kth distinct experiment E, can result in n, outcomes then the experiment 
E, or E, or, ..., or E, will result in n, + n, +... + n, outcomes, provided E,, E,, ..., Ё, 
cannot occur simultaneously. 

Note. When the English word concerning numbers is or (in the exclusive sense : not 
both) use Rule of Sum. When the English word concerning numbers is and, use Rule 


of Product. 


2. Sampling of Two objects out of Four Distinct objects, Generalizations 


XZ 


ух yy yz yt 


it eee «34 


Without replacement, Without replacement, With replacement, With replacement, without 
i 4 ‚ 4 i 4 of te 2-1 
with order : Р, without order : (3) with order : 2 order : ( Y - ) 
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A. Sampling without replacement but with order | | 
distinct objects, without replacement, pyr 


lection of r objects from 7 | ! 
lled a permutation of n objects taken + at, 


A particular se 
on, is cà 


with regard to the order of selecti 
time, is denoted by "P, and 15 given by 
) 


"Р = nin-1)(n-2)..(n-r*D-n". 


B. Sampling without replacement and without order 
rom n objects, without replacement or any regard 


A particular selection of r objects f 
bination of n objects taken r at a time, denoted b, 


to order of selection, is called a com 


(^). ^C, or C(n, r) and is given by 


(r) 


эчү ud fepe .nn-D(n-2)..(n-r*D п. ^  [Binomial Coefficient 
r NEA ri(n—-r)! r! г. 


С. Sampling with replacement, but with order 
A particular selection of r objects from n objects, with replacement and with regard to 
order of selection, is called permutation with repetitions of n objects taken r at a time, 
or accumulation of n objects taken r at a time. This may be denoted by A(n, r) and is 
given by 

A(n, r) =n’. 
D. Sampling with replacement and without order 
A particular selection of r objects from n objects, with replacement and without any 


regard to order of selection is given by Rx pu 
я 


Number of possible arrangements of size r from n objects 


Without replacement With replacement 


n! 


n Н 
Риз la 
(пр)! 


Ordered 


n n! 
Unordered () (п-к)! г! 


E. Theorem on grouped permutations 

If n objects can be divided into k groups such that objects belonging to the 
group are alike, while objects belonging to different groups are different, then the 
number of permutations of these objects taken all at a time, is 


same 


n a n! | l T 
Belo 1 5! mi mh (nj +n, +...+n, =n). [Multinomial coefficie 
3. Occupancy Problems 


The number of ways, b balls can be distributed among N distinguishable cells. 
upon the fact ; how many balls are permitted to be in one cell and whether 


depends 
the balls 
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are distinguishable from one another or not. Problems involving the didiributibn of 
balls among cells are called occupancy problems. 

Theorem 1. The number of ways in which b distinct balls can be alloted to N (N > b) 
distinguishable cells, if at most one ball is permitted in a cell, is Np, = NI/(N – b)! 
Proof. Since each cell receives either 0 or 1 ball, it follows that the number of ways 
that we can choose the cells to be assigned balls is И = NI/(N – b)! 

Theorem 2. The number of ways in which b distinguishable balls can be alloted to N 
— cells, if no restriction is placed on the No. of balls permitted in a cell, 
15 № . | 

Proof. The first ball can be alloted in N ways. For each of these allotments, the second 
ball can also be allotted in N ways, etc. Thus, the total number of possible allotments 
is У (Rule of product). 

Fermi-Dirac Formula. The number of ways b identical balls can be allotted to N 


distinguishable cells, if only one ball is permitted per cell, is n: 


Proof. Since the balls are identical, the required No. of ways is, to choose b cells 
from N cells. 

Bose-Einstein Formula. The number of ways b identical balls can be allotted to N 
labelled cells when no restriction is placed on the number of balls permitted in any 


cell is 
ү е 3, Бача) 
b "EV E 


1 2 3 = М фы 
Proof. Represent the N cells by the spaces between N + 1 bars and represent the balls 
by • . Then there are N + 1 + b positions filled with N + 1 bars and b zeros. The first and 
last position will always be occupied by a bar. The required number is now the number 
of ways of placing b zeros in the remaining N + b — 1 positions. This is given by 


ES! m 
b Tb 
Integer Counting Rule. Find the number of solutions of the equation 


XjtXQ,t. +X, п. AU) 
(i) when each x, is strictly positive integer (x; > 0, V i) 
(ii) when each x,isa non-negative integer (x; 2 0, V i) 
Proof. (i) The number of solutions equals the number of ways of splitting a queue of 
n persons into k batches, each batch consisting of one or more persons. 
Now when n persons are standing in a row, there are (n — 1) gaps between them. 
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d by inserting (k — 1) barriers into thesi 
out of (n — 1) slots. This objective 


A split of this queue into k batches can be ha 
(n — 1) gaps. This amounts to choosing (k — 1) slots 


is attained in я H J ways. So, the numbers of positive integer solutions of equation (1) is 
k-1 


n-i 
v= (13) 
(ii) Write x 41 Sy, E AI k. Now х 202 2 1 > 9,79 The Eq. (1) in 
terms of variables y, is 


yptyt.ty,-7n4k, y»0 Vi 
By part (i), the number of solutions must be 


Ку НАКЕ 
„= (rit) 


E diu beata ырыл шык —— 
4. Matrix Inverse : 


a^ By l| d -b E А 4l. 
5 A = 14 4 ^-da|^ = ad bc. 


EBENE 1 x ou oou е esa aiu a_a 


5. Factorial Powers 
(i) The kth decreasing factorial power of x is denoted by x” and is defined by 


x? = xx-Dx-2)..(x-k41). 

(ii) The kth increasing (or reverse) factorial power of x is denoted by xl and is defined by 
ХА = х(х+1у(х+2)...(х+К— 1). 

(iii) Relations : x = Ep (x); x" zt (—х)!*! ; NO = N&O (N-k+ x)”. 


n? .(n —r)! n? = (n-r4 1)? 


n! 


(r) 
n nius r (r) ise аби, T TM Ep 
= = n = ah ms = ; 
(") = 07, r EE jas 


r 
! 
wel n—st+1)"! (n-s ; 
(") = s )- gm ( ) [7)=0.ite>n 
poe we ү у: OMS 
2 2 2. 
х= x? +; Pax +300) + x; x^ =x 46x +702 4 x; x3 = – х, y! = x91 c 34 + x. ас. 


Note. Some authors write (№), and [N]' for NUI. 

(ni п+1 n) (n-1 N E n n sak n n An 
ТТЫ Foo lt Aka) kei ks \k-1) 2-*t! 3 

6. Fundamental Expansions 

Taylor Series. The Taylor series for f(x) about x — a is given by 


2 n-i 
f(x) = flay+(x—a) f+ €29- у"ду+ „+ LO O R, 
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ky | 
where E un E [4 fo) ахх); R, = f" (0)(x — а)" /n!, а<0 < х. 
e = ехр(х)=1+ СТЕ = mira 
Kv ted = peg A oc9«x«x 
т(1+ x) = pu n: Ж V TES 
eee ei 
33 5 n- à к 22k 
sin x = EE ME rU t S sd Acl : 
2 4 2n K-2K 
ESE ET ES С) х 
Пы ii GOD M 2 o 
3 
a 2 fs ily 62 
ILLO. e a Wa rg. 
3.1034 «gg sited 2835 * a" 


3 5 
sin'x = e e 


3 5 7 n .2n«l 
ELE ux [x | [x oae Gee 
РУ (5 )+(4) Б i (2л +1) 


sin ¿ð = іѕіпһ Ө, cosi0- соѕћ Ө, соѕһ Ө = соѕӨ, зѕіпһ 10 = / sin 0 


id -i8 ið —ið СӨ -0 6 -0 

] —e e +e 5 e —e e +e 
sin 0 = EX S созын T sinh 0 = 2 ;cosh0 = > 
Taylor series for f(x, у) about x =a, y= b. Let h = x -a, k = y - b. Then 


fü, y) = f(a, b) + [hf (a, b) + kf, (a, b)] + [h° f. (a, Б) + 2hk f. (a, b) + K f, (a, b) 21+... 


7. Binomial Expansions and Binomial Coefficients 
(i) If n is a positive integer, then 


car (Qe Qe en Den 


(ii) If n is any real number, then 


(1 4 x)" Lene 19 D x Же 


fem nrp su 


Neg-bin Expansion 


(d -= х)" 


Beer) OE) (еве) 


H 
Ms 
pu 
з 
+ 
в. 
| 
ҖЕ у; 
= 
ч 
il 
Ms 
l 
= 
— 
mm 
i 
= 
— 
= 
= 
V 
о 
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ised or head-decre: жез vn increased. Fo; 


These indicate head-decreased, tail-decre: 


proofs, write, e.g. rt = Aa ) and find А, etc. reversed results are immediate. 


8. The Hypergeometric Identity 
Let a, b be real numbers and n a positive integer. Then 


ABL - 07) 4 
(1+ у) (1+ у)” = Р (o) ЯР () J 
E £ 00У" » 


n=0 k=0 j=0 


Proof. (19 у)“ 


Equating Coefficient of y" [n = k + j] on both sides of (1) yields (A) 


9. A note on Geometric Progression 
Гааге" = ermy-r) 
If la | « 1, the infinite geometric series 
sa = ata t+a’+..=a/(i-@),, r=1,2,3.... "0 


is uniformly convergent. Repeatedly differentiating (1) w.r.t. “а” we recover 


Era | = 1/0- ay ог Xra -a[l(»-a)?. (2) 
уа! = (+a) (l-a)? => Era =a(l+a)(1-a)” Mei 
ае i aaa => Era =[2а? + a(1 ay ]/(1 - a) ...(4) 


The process of differentiation can be carried out any number of times, etc. 


Sums of Powers of Natural Numbers 


> e nn D. " p mat Dens, Y Exam. 
kzl k=l k=l 


ee n(n + 1) (2п + 1) (3n? + Зп – 1) 
NN 30 


10. Leibniz's Theorem on nth Derivative of a Product 

D' qw) =(D'w).v + (") ("= D) + (7) (D2 a «(e ru (D v) s. () (д) 0 
11. Some Properties of Definite Integrals 

P, foo dx = 0, Gf fis odd) ; f^, foo dx = 2j; f(x)dx, Gf f is even). 

ре f(x) dx = 0, if fQa- х) = f(x); е f(x) dx = 2f; f(x) dx, if fQa - x)= fO» 
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Some Special Integrals 


ax - b = b zs à ' | <; b; 
fe^ sin bx dx io d (a а : cos x) few cos by E 2 е (а EM I sin E 
(а * b^) "v. Br 
| dx " 1 os” b+acosx | {г cos сечи dil эй иу» b> 0 
a+bcos x a -b a+bcos x E RE ey? 2b 
f. -(ax tbrec) dy » (о? = +0 
a 
2 
| exp [-p^x! + qx} dx = 1356 e p>0 
y"! p 4p 
п- 1 А 
© m -px +2gx - 1 E d qe!” А р>0 
i e dx a g p dq"! | ) 
о {© 2 2 x T 
f°, f. exp[- (ax? + 2hxy + by*)| didy = —*—. 
жәй ab-h 


: г 
fc fe exp[-(ax? + 2hxy by?) 0 = NEL [un ) 


o fo 1 2 гед tal | dx dy = 2x (i A) 
aed ec exp E (ax zr 2hxy ar by х 2ту y cary exp 2 
where A = (am? —2hlm + bI^)/ (ab — h^). 


В? 2Aa + B 
fc exp - Ax! - Bx) dx = 'ESEA EI J2A )|.4> 


Proof. As Ax! + Bx = (x А +B/2VA) - (B*/4A), we get 


j= oo (Fe Ain el - (xa + Ba) |a (Ри HA a a =| 
= exp tatan ла а). E exp E af 1-Ф()) [$:c4.f.of NO, D] 


"^ B? ) 2Аа + B | ae: 
== т i t— > (Find values when а. Y. 
Н (2, | | /2А 
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Kronecker General Rule of Integration by Parts 

[pœ fé) ах = ph = pF, + p" Fy - p" F,* 
where p(x) is a polynomial of degree т, р’, р", 
F, denotes ап indefinite integral of f, F, an in 
sivernating signs are affixed to the terms. Use 
only when the process is complete. 


| ( i)? pm Е, - 


.. are successive differentiations of p 
definite integral of F;, and so on, and 
brackets for evaluations and simplify 


12. Gamma Integral and Some of its Properties 


Du) e L ex dy a» (Definition) 


Га) 4,20, a>0. 
(2)° 


(a) F(k) = (k — 1) 5, (if k is positive integer). 


p eu ха! dx = 


Working Definition : 


(b) F(-n) > © (n> 0 is an integer) 


(c) P(x) = (x- 0 Г(х – 0), [Recurrence Formula]. (d) Г(1) = Ут. 

(е) Г(п + 1) = 2n! Jn / 27" (n. (f) Jn F 2n) = Q^! (n) F(n * 3) (Duplication Formula). 
ГО siis Phr 1 r(2)- E DNE оаа) 

Р Тыр vat АТ or Е 5/2127! 


a ^i my T[(p+ D/2]T [(q + 5/2] 
aS 0 <p <i 12s P І милы оч 
(h) ГОР)Га – р). = sin pa p<! (i) Г sin" 0 cos! Ө dO Wiptq+Di2 ` 
Еа аа 
13. Beta Integral 
Let a » 0, Б> 0. 
goon EE » x'"'dx  Y(a)I(c- a) 
Bla, b) = [x а; Ba Б) = f; —— EE а) ,.0 
EE AE (a,b) - } СР эту fidei)" к“ T(c) 
_ Г(а) Г) 
B(a, b) = B(b, a) (symmetry) ; В(а, р) = Tab MERI 


(Relation with Gamma integral) 


Gamma Function Limit: lim E. ], Кызы апі 
no (n) D (n) Г(К) 
Proof. Using gamma-beta relation we have 
lim nt - lim nt fat оү d 
Put x = y/n in the R.H.S. to get 


n=l 
limf у 2) dy = h y" e'dysT(À) 


г) => lim EID : 2 m 


k 
Thus (1 im 4——-———.—- 
us (1) gives : tim |" Tin +B) |- Оя 
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14. Euler’s Limit 
If lim ф(л) = а, as п 90, then 


3 bnc 

bn + à 
ф(л) i a M 
А i E uU" « : ab . a ] TH 
lim (i, 20 EX . lm 1+4) =e"; |іт|1+ = -o| | е“ 
n> 1 n— o n n n “Л 


15. Stirling’s Approximation 


When n is very large nl Soe Ot A 
If n, К and n — К are sufficiently large, this result provides 


k+1/2 n-—k+1/2 
ы 5 1 B n 
Куз /2лл \k n—k 


16. Differentiation Under Integral Sign (DUIS) 
Under differentiable conditions let 


F(t) = ж f(t, x) dx; a, b functions of t. 
dF() _ » Of(t,x) dbA „Ё da 
Then ove L = dx + f(t, b) = f(t,a) i 


e EC Ут -2ab . Bes? КБК ОМ 
o Pla x (b Ix ar е “УО, БРО: ki ax=1 | 


17. Euler-Maclaurin Sum Formula 
If [x] = greatest integer contained in x, then 


fou = fede duo fons p (s-ta- 1) Paas. 
k=0 


18. A note on Functions with Simple Discontinuities 


Let a be any point within the domain of definition of a function f. Any point to the 
right of a is x =a + £, (e > 0). As = — 0 the point a + є — a from the right. If the 
corresponding values fla + €) tend to a limiting value then this value is called the right 
hand limit of f as x — a and is denoted by f(a +). Formally 


f(a+0) = lim f(a + є). 


If in addition, lim Да + £) = fla), as € > 0, then f is said to be continuous from the right 
at a. Similarly, f is said to be continuous from the left at a, if, ^ 


fla - 0) = lim f(a € €) = f(a). 
Clearly, f is continuous at a iff it is continuous both from the right and from the left ; thus 
lim f(a + £)- f(a) = lim f(a * €), (£5 0). 


If f(a +) and f(a —) both exist but are unequal in value, then f is said to have simple or 
jump discontinuity at a. The number k 
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k= /(а + 0)— f(a - 0) = (а + ) - /(а—) [some write k = f (a^) f (а )| 
is called the jump ог saltus of f at а. 
From elementary analysis, we borrow the simple results : 
1. If fis monotonic on R, then f(x +) and f(x —) both exist for each x € R. Further, both 
the infinite limits 
lim f(x) = Ў); lim Р(х) = fG 9) 
also exist for monotonic function f. 


2. A bounded monotonic function has atmost countable number of the points of jump 
discontinuties. 


19. Unit Step Function 
This is defined as under 
u(x) = 1 forx»0 
Ec forx-0 
0, forx «O0 x-a 


Some authors define u(0) = 0, or u(0) = 1 or и(0) = 1/2 and each value has its defenders. 
Note that, u(0) = 0 gives a function u which is continuous from the left at O ; 4(0) = | 
gives a function u,, which is continuous from the right at 0. 


Importance of unit step function. Suppose y is a function continuous everywhere 
except at x = a, where it has a simple discontinuity. Then y can always be expressed as 
a linear combination of two functions f and g which are continuous everywhere but 


which have been truncated at x = a. 
f(x) for x «a 


y(x) = f(x) u(a х) + g(x) шх — a) i.e. vo-| 


g(x) for x»a 


20. Derivative of the Unit Step Function. Dirac Delta Function 
For all x 2 0, и'(х) = 0. At x = 0, however, there is a jump discontinuity and the 


definition of derivative accordingly fails. Further 
[n0 sg 


east, the derivative of и would appear t° be 
S(x), which has the following р! 


lim 
hod 


Thus, from a descriptive point of view at | 


a function, called Dirac delta function, written 


wise specification : 
0, forall x #0 


oo, for x=0 


(x) = u'(x) -| 


21. Sifting Property of Delta Function 
Let @ be any function continuous on a neighbourh 
Then we should have 


< d. 
ood of zero, say for -a < * 
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L. ф(х) u'(x) dx = ‚ы. р(х). lim (^4 Fer uo MO) a 


EE: h 0 h 
Assume that it is permissible to interchange the operations of integration and taking 
limits as Л — 0 ; this gives, using the first МУТ of Integral Calculus, 


i ф(х) u'(x) dx = т zl, ф(х) dx = lim p(t) 


where els veg uM point lying between —h and 0. Since ф is assumed to be continuous in 
the neighbourhood of zero, it follows that 


JF, (x) (x) ах = o(0) [Sifting Property of Delta Function] 
= ОПХ = с) f(x) ах = f(c) V f and Ve > 0 
Remarks : j^ ф(х) ӧ(х -c)dx = ф(с) [Sifting Property] 
if x #a 


, - ы 
и'(х a) =. 8(x—a), 5(-х) = (х). (x-a) = 


түл 
22. Hyper-geometric Series 
A power series with parameters a, b, c and defined by 


n ^^ ғ) ab аа+)-ЫЬ+) x*  aa*D(ar2.bb*D(br2) х. (р) 
Wer c(c * 1) 2! c(c * 1) (c +2) Эб 

where 1 <x < 1 and c > a + b - 1, is called Hypergeometric series. 

In terms of Factorial Powers, this can be re-written as 


onal) nts oo (9), (i) ) 
Aes x] = 1+ У И) оор рр + У, Ы БА ш. I х)! LED 


vere СОТА ee CHS у 
as aU! = (-1)/ (-a)”, etc. 
Sometimes, the L.H.S. of (1) written F(a, b ; c | x). Some special cases аге: 
F(n1;-1;-x) 9 +x)"; FE p a Aa" 
F(, 1;2;-x) = (I/x)In(l x); F(4,4;3;x°)=(1/x)sin™ x. 
The H.G. series (1) are the solutions of the differential equations 
t(1—1) (d?x/dt?) + [c-(1+.a+b) t] (dx/dt)—abx = 0. ...(3) 


FOR STATISTICAL THEORY 


Lebesgue’s Theorem E(lim X, | = lim E(X,) 


nf oo 


Differentiation Under the Expectation Sign (DUES) 
d е d 
di E(X): = E(4 i a «t «b. 
Cinema is the most beautiful fraud in the world. (Gean-L Goduray) 


But Music is the strongest form of magic. (Marilyn Manson) 


оченче 


Table 1. Standard Normal Distribution Function 


0.0003 
0.0004 
0.0006 
0.0008 
0.0011 
0.0015 
0.0021 
0.0029 
0.0039 
0.0052 
0.0069 
0.0091 
0.0119 
0.0154 
0.0197 
0.0250 
0.0314 
0.0392 
0.0485 


0.0594 
0.0721 


0.0869 
0.1038 
0.1230 
0.1446 
0.1685 
0.1949 
0.2236 
0.2546 
0.2877 
0.3228 
0.3594 
0.3974 
0.4364 
0.4761 


0.07 


di 
0.08 


0.0003 
0.0004 
0.0005 
0.0007 
0.0010 
0.0014 
0.0020 
0.0027 
0.0037 
0.0049 
0.0066 
0.0087 
0.0113 
0.0146 
0.0188 
0.0239 
0.0301 
0.0375 


`- 0.0465 


0.0571 
0.0694 
0.0838 
0.1003 
0.1190 
0.1401 
0.1635 
0.1894 
0.2177 
0.2483 
0.2810 
0.3156 
0.3520 
0.3897 
0.4286 
0.4681 


0.09 


0.0002 
0.0003 
0.0005 
0.0007 
0.0010 
0.0014 
0.0019 
0.0026 
0.0036 
0.0048 
0.0064 
0.0084 
0.0110 
0.0143 
0.0183 
0.0233 
0.0294 
0.0367 
0.0455 
0.0559 
0.0681 
0.0823 
0.0985 
0.1170 
0.1379 
0.1611 
0.1867 
0.2148 
0.2451 
0.2776 
0.312! 
0.3485 
0.3859 
0.4247 
0.4641 


P(Z<2=F iut ^ 
(Z < 2) = F(z) = т 
КАЕ iS ааа —————.— 
z 0.00 morc mos 005 . 0.04. 0.0... 0, | ; 
-5.0 0.0000003 
—4.0 0.00003 
-3.5 0.0002 
-3.4 0.0003 0.0003 0.0003 0.0003 0.0003 0.0003 
-3.3 0.0005 0.0005 0.0005 0.0004 0.0004 0.0004 
-3.2 0.0007 0.0007 0.0006 0.0006 0.0006 0.0006 
-3.1 0.0010 0.0009 0.0009 0.0009 0.0008 0.0008 
-3.0 0.0013 0.0013 0.0013 0.0012 0.0012 0.0011 
-2.9 0.0019 0.0018 0.0018 0.0017 0.0016 0.0016 
-2.8 0.0026 0.0025 0.0024 0.0023 0.0023 0.0022 
-2.7 0.0035 0.0034 0.0033 0.0032 0.0031 0.0030 
-2.6 0.0047 0.0045 0.0044 0.0043 0.0041 0.0040 
-.2.5 0.0062 0.0060 0.0059 0.0057 0.0055 0.0054 
-24 0.0082 0.0080 0.0078 0.0075 0.0073 0.0071 
-23 0.0107 0.0104 0.0102 0.0099 0.0096 0.0094 
-22 0.0139 0.0136 0.0132 0.0129 0.0125 0.0122 
21 0.0179 0.0174 0.0170 0.0166 0.0162 0.0158 
-20 0.0228 0.0222 0.0217 0.0212 0.0207 0.0202 
_19 0.0287 0.0281 0.0274 0.0268 0.0262 0.0256 
_18 0.0359 0.0351 0.0344 0.0336 0.0329 0.0322 
41.7 0.0446 -0.0436 0.0427 0.0418 0.0409 0.0401 
_16 0.0548 0.0537 0.0526 0.0516 0.0505 0.0495 
_15 0.0668 0.0655 0.0643 0.0630 0.0618 0.0606 
-14 0.0808 0.0793 0.0778 0.0764 0.0749 0.0735 
_1з 0.0968 0.0951 0.0934 0.0918 0.0901 0.0885 
-12 0.1151 0.1131 0.1112 0.1093 0.1075 0.1056 
-11 0.1357 0.1335 0.1314 0.1292 0.1271 0.1251 
-10 0.1587 0.1562 0.1539 0.1515 0.1492 0.1469 
-09 0.1841 0.1814 0.1788 0.1762 0.1736 0.1711 
08 0.2119 0.2090 0.2061 0.2033 0.2005 0.1977 
07 0.2420 0.2389 0.2358 0.2327 0.2296 0.2266 
06 0.2743 0.2709 0.2676 0.2643 0.2611 0.2578 
0.5 0.3085 0.3050 0.3015 0.2981 0.2946 0.2912 
дул 0.3446 0.3409 0.3372 0.3336 0.3300 0.3264 
0.3 0.3821 0.3783 0.3745 0.3707 0.3669 0.3632 
_0.2 0.4207 0.4168 0.4129 0.4090 0.4052 0.4013 
-0.1 0.4602 0.4562 0.4522 0.4483 0.4443 0.4404 
-0.0 0.5000 0.4960 0.4840 0.4801 
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Table 1. Standard Normal Distribution Function 


P(Z <z} = F(z) кыга dt s 


| 
Ап 


02 


Z 0.00 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 


E E een E E O E 
0.0 0.5000 0.5040 0.5080 0.5120 0.5160 0.5199 0.5239 0.5279 0.5319 0.5359 


0.1 0.5398 0.5438 0.5478 0.5517 0.5557 0.5596 0.5636 0.5675 0.5714 0.5753 
0.2 0.5793 0.5832 0.5871 0.5910 0.5948 0.5987 0.6026 0.6064 0.6103 0.6141 
0.3 0.6179 0.6217 0.6255 0.6293 0.6331 0.6368 0.6406 0.6443 0.6480 0.6517 
0.4 0.6554 0.6591 0.6628 0.6664 0.6700 0.6736 0.6772 0.6808 0.6844 0.6879 
0.5 0.6915 0.6950 0.6985 0.7019 0.7054 0.7088 0.7123 0.7157 0.7190 0.7224 
0.6 0.7257 0.7291 0.7324 0.7357 0.7389 0.7422 0.7454 0.7486 0.7517 0.7549 
0.7 0.7580 0.7611 0.7642 0.7673 0.7704 0.7734 0.7764 0.7794 0.7823 0.7852 
0.8 0.7881 0.7910 0.7939 0.7967 0.7995 0.8023 0.8051 0.8078 0.8106 0.8133 
0.9 0.8159 0.8186 0.8212 0.8238 0.8264 0.8289 0.8315 0.8340 0.8365 0.8389 
1.0 0.8413 0.8438 0.8461 0.8485 0.8508 0.8531 0.8554 0.8577 0.8599 0.8621 
11 0.8643 0.8665 0.8686 0.8708 0.8729 0.8749 0.8770 0.8790 0.8810 0.8830 
1.2 0.8849 0.8869 0.8888 0.8907 0.8925 0.8944 0.8962 0.8980 0.8997 0.9015 
1.3 0.9032 0.9049 0.9066 0.9082 0.9099 0.9115 0.9131 0.9147 0.9162 0.9177 
1.4 0.9192 0.9207 0.9222 0.9236 0.9251 0.9265 0.9279 0.9292 0.9306 0.9319 
1.5 0.9332 0.9345 0.9357 0.9370 0.9382 0.9394 0.9406 0.9418 0.9429 0.9441 
16 0.9452 0.9463 0.9474 0.9484 0.9495 0.9505 0.9515 0.9525 0.9535 0.9545 
17 0.9554 0.9564 0.9573 0.9582 0.9591 0.9599 0.9608 0.9616 0.9625 0.9633 
|.8 0.9641 0.9649 0.9656 0.9664 0.9671 0.9678 0.9686 0.9693 0.9699 0.9706 
|9 0.9713 0.9719 0.9726 0.9732 0.9738 0.9744 0.9750 0.9756 0.9761 0.9767 
30 0.9772 0.9778 0.9783 0.9788 0.9793 0.9798 0.9803 0.9808 0.9812 0.9817 
21 0.9821 0.9826 0.9830 0.9834 0.9838 0.9842 0.9846 0.9850 0.9854 0.9857 
2.2 09861 0.9864 0.9868 0.9871 0.9875 0.9878 0.9881 0.9884 0.9887 0.9890 
2.3 0.9893 0.9896 0.9898 0.9901 0.9904 0.9906 0.9909 0.9911 0.9913 0.9916 
24 0.9918 0.9920 0.9922 0.9925 0.9927 0.9929 0.9931 0.9932 0.9934 0.9936 
2.5 0.9938 0.9940 0.9941 0.9943 0.9945 0.9946 0.9948 0.9949 0.9951 0.9952 
26 0.9953 0.9955 0.9956 0.9957 0.9959 0.9960 0.9961 0.9962 0.9963 0.9964 
37 0.9965 0.9966 0.9967 0.9968 0.9969 0.9970 0.9971 0.9972 0.9973 0.9974 
28 0.9974 0.9975 0.9976 0.9977 0.9977 0.9978 0.9979 0.9979 0.9980 0.9981 
29 0.9981 0.9982 0.9982 0.9983 0.9984 0.9984 0.9985 0.9985 0.9986 0.9986 
30 0,9987 0.9987 0.9987 0.9988 0.9988 0.9989 0.9989 0.9989 0.9990 0.9990 
3.1 0.9990 0.9991 0.9991 0.9991 0.9992 0.9992 0.9992 0.9992 0.9993 0.9993 
3.2 09993 0.9993 0.9994 0.9994 0.9994 0.9994 0.9994 0.9995 0.9995 0.9995 
3.3 0.9995 0.9995 0.9995 0.9996 0.9996 0.9996 0.9996 0.9996 0.9996 0.9997 
3.4 0.9997 0.9997 0.9997 0.9997 0.9997 0.9997 0.9997 0.9997 0.9997 0.9998 
3.5 0.9998 

4.0 0.99997 

5.0 0.9999997 
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2. Areas under the Standard Normal Curve from 0 to z 
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P(0sZsz)e wf 


l 


Von 


-1^/2 dt 


Table 3. Ordinates (y) of the Standard Normal Curve at z 


.0040 


.0016 
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3988 
3956 
3885 
3778 
.3637 
.3467 
3271 
‚3056 
.2827 
.2589 
.2347 
.2107 
.1872 
.1647 
.1435 
.1238 
.1057 
.0893 
.0748 
.0620 
.0508 
.0413 
.0332 
.0264 
.0208 
.0163 
.0126 
.0096 
.0073 
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Table 4. Values of х2 (У) 
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vzn-1l 


=< 


I p p te — 
| 420.995 а= 0.99 а= 0.975 а = 0.95 a = 0.05 а = 0.025 a = 0.01 а = 0.005 v 
MUN M UE hh LL СК RET ee 

0.0000393 0.000157 0.000982 0.00393 3.841 5.024 6.635 7.879 | 


І 
2 0.0100 0.0201 0.0506 0,103, 5.991... 7.378 9.210 10.597 2 
3 0.0717 0.115 0.216 0.352 7.815 9.348 11044 12.838 3 
4 0.207 0.297 0.484 0.711 9.488 11.143 13.277 14.860 4 
5 0412 0.554 0.831 1.145 11.070 12.832 15.056 16.750 5 
6 0.676 0.872 1.237 1.685 . 12.592 14.449 16.812 18.548 6 
7 0.989 1.239 1.690 2.167 14.067 16.013 18.475 20.278 7 
8 1.344 1.646 2.180 2.089 915.5077 7.939 20.090 21.955 8 
| icti Dr 2.088 2.700 3:324 7" 16.919" 19.025 71,600 23.589 9 
10 2.156 2.558 3.247 3.940 18.307 20.483 23.209 25.188 10 
11 2.603 3.053 3.816 Аер LR y a РЈ: EN #65057 11 
12 3.074 "yd 4.404 8.22054 21.0204 23.227 ARA 25300 12 
15, 3.563 4.107 5.009 5.892. 22.362 24.736 27,688 29.819 13 
14 4.075 4.660 5.629 6.51551 23.6855 26.119 29.141 31.319 14 
15 4.601 5:229 6.262 7.261 24.996 27.488 30,578 32:801 15 
1625.142 5.812 6.908 7.962 26.296 28.845 32.000 34.267 16 
1715.697 6.408 7.564 8.67001 327,5874./30.191 33.409 35.718 17 
18 6.265 7.015 8.231 9.390 28.869 31.526 34.805 37.156 18 
19 6.844 7.633 8.907 10.117 30.144 32.852 364001 38:582 19 
20 7.434 8.260 9.591 10.851 31.410 34.170 37.566 39.997 20 
21 8.034 8.897 10.283 11.591 32.671 35.479 38.932 41.401 21 
22 8.643 9.542 10.982 12.338-* 33.924" 36.781 40.289 42.796 22 
23 9.260 10.196 11.689 13.091 35.172 38.076 41.638 44.181 23 
24 9.886 10.856 12.401 13.484 36.415 39.364 42.980 45.558 24 


25 10.520 11.524 13.120 14.611 37.652 40.646 44.314 46.928 25 
26 11.160 12.198 13.844 15.379 38.885 41.923 45.642 48.290 26 
27 11.808 12.879 14.573 16.151 40.113 43.194 46.963 49.645 27 
28 12.461 13.565 15.308 16.928 41.337 44.461 48.278 50.993 28 
29 13.121 14.256 16.047 17.708 42.557 45.772 49.588 52.336 29 
30 13.787 14.953 16.791 18.493 43.773 46.979 50.892 53.672 30 
40 20.706 22.164 24.433 26.509 55.758 59.342 63.691 66.766 40 
50 27.991 29.707 32.357 34.764 67.505 71.420 76.154 79.490 50 
60 35.535 37.485 40.482 43.118 79.082 83.298 88.379 91.952 60 
70 43.275 45.442 48.758 51.739 90.531 95.023 100.425 104.215 70 
80 51.172 53.540 57.153 60.391 101.879 106.629 112.329 116.321 80 


90 59.196 61.754 65.646 69.126 113.145 118.136 124.116 128.299 90 
135.807 140.169 100 


100 67.328 70.065 74.222 77.929 124.342 129.561 ere" 


Table 5. Values of ¢,(v) 


- 


EMO Ae eh 


— 
— 


— _— 
шо һә 


inf. 


a = 0.10 


3.078 
1.886 
1.638 
1.533 
1.476 
1.440 
1.415 
R397 
1.383 
1:372 
1.363 
1.356 
1.350 
1.345 
1.341 
1,837 
1.333 
1.330 
1.328 
1.325 
1.323 
1.321 
1,319 
1.318 
1.316 
1,315 
1.314 
1.313 
1.211 
1.282 


a=0.05 a20025 со = 0.01 а = 0.00833 о = 0.00625 a = 0.005 


6.314 
2.920 
2.353 
2.132 
2.015 
1.943 
1.895 
1.860 
1.833 
1.812 
1.796 
1.782 
NE E 
1.761 
1:353 
1.746 
1.740 
1.734 
14529 
1.725 
1.721 
1:217 
1.714 
be? hd 
1.708 
1.706 
1.703 
1.001 
1.699 
1.645 
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12.706 
4.303 
3.182 
2.716 
2:971 
2.447 
2.365 
2.306 
2.262 
2.228 
4.201 
2,179 
2.160 
2.145 
2.131 
2.120 
2.110 
2.101 
2.093 
2.086 
2.080 
2.074 
2.069 
2.064 
2.060 
2.056 
2.052 
2.048 
2.045 
1.960 


31.821 
6.965 
4.541 
3.747 
3.365 


3.145 


2.998 
2.896 
2.821 
2.764 
2.718 
2.681 
2.650 
2.624 
2.602 
2.583 
2.567 
2.352 
2.939 
2.528 
2.518 
2.508 
2.500 
2.492 
2.485 
2.479 
2.473 
2.467 
2.462 
2.326 


38.204 
7.650 
4.857 
3.961 
3.534 
3.288 
3:128 
3.016 
2.934 
2.870 
2.820 
2.780 
2.746 
2.718 
2.694 
2.673 
2.655 
2.639 
2.625 
2.613 
2.602 
2.2591 
2.582 
2.574 
2.566 
2.559 
4.299 
2.547 
2.541 
2.394 


=—— 


50.923 
8.860 
5.392 
4.315 
3.810 
3.2521 
3.335 
3.206 
Salis 
3.038 
2.981 
2.934 
2.896 
2.864 
2.837 
2.813 
2,193 
2.775 
2.799 
2.744 
2.182 
2.720 
2.710 
2.700 
2.692 
2.684 
2.676 
2.669 
2.663 
2.498 


63.657 
9.925 
5.841 
4.604 
4.032 
3.707 
3.499 
3.355 
3.250 
3.169 
3.106 
3.055 
3.012 
2.977 
2.947 
2.921 
2.898 
2.878 
2.861 
2.845 
2.831 
2.819 
2.807 
2.797 
2.787 
2.779 
2.771 
2.763 
2.756 
2.576 


а 


inf. 


һә 


15. 


16. 
17. 
18. 


The less routine, the more life. (A. Bronson Alcot) 
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Introducing Probability reaching the mid-high, although it starts 
at the lowest level of basic fundas. It intends to inculcate In the reader's mind an intuitiv e as 
well as the mathematical feel for the subject which is so essential for scientific thinki ng. 

Most of the standard topics are included, but a few are omitted, which are given in authors 
New Mathematical Statistics (1 989). Just a glance over Partial Contents reveals the topics 


covered. T 
The vastly-covered topics are profusely illustrated by over 900 fully worked-out distinct 


Problems, of which 542 are starred and their solutions are provided at the back of the Text 
(pp : 659-818). This shall help rapid coverage and flexibility of available choices. 
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